-- Logs begin at Thu 2022-06-16 15:17:44 UTC, end at Thu 2022-06-16 16:45:18 UTC. -- Jun 16 16:03:45.882753 dv-cinder-837354-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 16:03:45.891841 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 16:03:45.893831 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 16:03:45 2022] *** Jun 16 16:03:45.893831 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 16:03:45.893831 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 16:03:45.893831 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: nodename: dv-cinder-837354-2-iscsi Jun 16 16:03:45.893831 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: machine: x86_64 Jun 16 16:03:45.893831 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: clock source: unix Jun 16 16:03:45.893831 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: pcre jit disabled Jun 16 16:03:45.893831 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: detected number of CPU cores: 4 Jun 16 16:03:45.893831 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: current working directory: / Jun 16 16:03:45.893831 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: detected binary path: /usr/bin/uwsgi-core Jun 16 16:03:45.894434 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: your processes number limit is 47680 Jun 16 16:03:45.894434 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: your memory page size is 4096 bytes Jun 16 16:03:45.894434 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: detected max file descriptor number: 2048 Jun 16 16:03:45.894434 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: lock engine: pthread robust mutexes Jun 16 16:03:45.894434 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: thunder lock: enabled Jun 16 16:03:45.894434 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 16:03:45.894434 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 16:03:45.938270 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: Python main interpreter initialized at 0x558ede1589c0 Jun 16 16:03:45.938270 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: python threads support enabled Jun 16 16:03:45.938270 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: your server socket listen backlog is limited to 100 connections Jun 16 16:03:45.938270 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: your mercy for graceful operations on workers is 90 seconds Jun 16 16:03:45.938639 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 16:03:45.938702 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: *** Operational MODE: preforking *** Jun 16 16:03:45.938965 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: *** uWSGI is running in multiple interpreter mode *** Jun 16 16:03:45.938965 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: spawned uWSGI master process (pid: 103340) Jun 16 16:03:45.939177 dv-cinder-837354-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 16:03:45.942207 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: spawned uWSGI worker 1 (pid: 103341, cores: 1) Jun 16 16:03:45.942207 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: spawned uWSGI worker 2 (pid: 103342, cores: 1) Jun 16 16:03:45.942207 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 16:03:46.599041 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 16:03:46.600425 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 16:03:47.781083 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:03:47.781083 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: from cryptography.utils import int_from_bytes Jun 16 16:03:47.781756 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:03:47.781756 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: from cryptography.utils import int_from_bytes Jun 16 16:03:47.782168 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:03:47.782168 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: from cryptography.utils import int_from_bytes Jun 16 16:03:47.782325 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:03:47.782325 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: from cryptography.utils import int_from_bytes Jun 16 16:03:50.356795 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 16:03:50.357477 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 16:03:50.357576 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 16:03:50.357953 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 16:03:50.358132 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 16:03:50.358497 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 16:03:50.358588 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 16:03:50.358679 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.358973 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.359075 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 16:03:50.359300 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.359484 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 16:03:50.359636 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.359833 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 16:03:50.359936 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.360249 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.360390 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.360575 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.360811 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.360916 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.361133 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.361237 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.361448 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.361555 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.361785 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.361875 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.362094 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.362187 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837354-2-iscsi {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.362411 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.362509 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.362716 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.362812 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.363028 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.363121 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.363284 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.363385 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.363594 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.363688 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.363913 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837354-2-iscsi {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.364007 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.364230 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.364323 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.364532 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.364724 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.364837 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.365929 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.366084 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.366213 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.366342 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.366472 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.366591 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.366713 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.366841 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.366841 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.367093 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.367237 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.367350 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.367476 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.367611 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.367735 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.367866 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.368001 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.368119 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.368249 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.368388 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.368518 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837354-2-iscsi {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.368635 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.368763 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.368897 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.369027 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.369144 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.369266 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.369394 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.369605 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.369863 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.370006 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.370287 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.370463 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837354-2-iscsi {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.370651 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.370797 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.371028 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.371163 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.371314 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.371440 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.371562 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.371690 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.371820 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.371992 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.372119 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.372241 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.372432 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.372571 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.372738 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.372878 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.373050 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.373184 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.373344 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.373479 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.373666 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.373823 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.374002 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.374128 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.374310 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.374936 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.375072 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.375204 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.375388 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.375518 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.375712 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.375847 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.376034 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.376164 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.376358 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.376497 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.376622 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.376758 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.376889 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.377020 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.377153 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.377277 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.377473 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.377615 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.377801 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.377941 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.378109 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.378244 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.378382 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.378506 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.378629 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.378753 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.378881 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.379005 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.379193 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.379332 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.379498 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.379633 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.379803 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.379931 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.380105 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.380234 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.380408 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.380542 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.380711 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.380852 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.381003 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.381249 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.381377 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.381507 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.381631 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.381837 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.381974 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.382105 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.382229 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.382390 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.382524 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.382731 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.382869 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.383055 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.383183 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.383370 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.383497 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.383691 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.383826 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.383999 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.384130 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.384313 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.384452 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.384621 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.384748 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.384924 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.385061 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.385248 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.385462 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.385622 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.385768 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.385961 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.386159 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.386296 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.386469 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.386598 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.386825 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.386966 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.387099 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.387223 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.387403 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.387532 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.387675 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.387799 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.387980 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.388123 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.388281 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.388409 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.388594 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.388727 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.388895 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.389031 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.389196 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.389324 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.389497 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.389632 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.389799 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.389936 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.390161 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.390894 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.391027 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.391157 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.391371 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.391576 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.391701 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.391830 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.391959 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.392082 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.392242 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.392380 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.392545 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.392669 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.392848 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.392981 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.393151 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.393277 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.393462 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.393601 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.393798 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.393938 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.394104 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.394237 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.394407 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.394532 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.394710 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.394850 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.395013 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.395155 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.395327 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.395461 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.395631 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.395756 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.395933 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.396078 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.396246 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.396373 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.396545 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.396672 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.396845 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.396973 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.397156 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.397289 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.397457 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.397591 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.397768 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.397911 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.398091 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.398225 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.398388 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.398515 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.398692 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.398819 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.398999 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.399134 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.399299 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.399433 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.399599 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.399727 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.399897 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.400024 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.400196 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.400332 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.400494 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.400620 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.400789 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.400926 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.401087 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.401230 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.401370 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.401561 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.401700 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.401851 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.401974 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.402111 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.402297 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.402426 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.402583 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.402711 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.402886 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.403022 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.403187 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.403321 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.403500 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:03:50.403638 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.403831 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.403961 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.404157 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.404285 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.404499 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.404626 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.404813 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.404942 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.405140 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.405268 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.405468 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.405602 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.406334 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.406464 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.406644 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.406772 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.406958 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.407097 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.407278 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.407405 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.407586 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.407714 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.407894 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.408032 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.408204 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.408355 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.408518 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.408648 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.408847 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.409001 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.409164 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.409335 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.409494 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.409638 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.409846 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.410092 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.410222 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.410463 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.410597 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.410808 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.410935 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.411157 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.411287 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.411476 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.411687 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.411816 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.411939 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.412117 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.412248 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.412433 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.412562 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.412747 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.412883 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.413094 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.413220 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.413375 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.413513 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.413696 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.413880 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.414029 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.414162 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.414337 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.414474 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.414645 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.414779 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.414959 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.415082 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.415274 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.415411 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.415581 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.415718 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.415893 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.416024 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.416201 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.416320 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.416518 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.416655 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.416844 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.416969 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.417161 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.417294 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.417483 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.417610 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.417819 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.417948 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.418135 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.418261 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.418449 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.418577 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.418755 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.418880 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.419062 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.419187 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.419368 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.419501 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.419673 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.419799 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.419979 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.420103 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.420278 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.420404 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.420578 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.420705 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.420879 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.421015 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.421185 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.421357 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.422148 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.422284 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.422416 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.422554 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.422713 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.422844 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.423026 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.423164 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.423337 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.423479 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.423644 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.423773 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.423952 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.424089 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.424258 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.424398 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.424562 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.424689 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.424862 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.424997 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.425170 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.425308 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.425478 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.425613 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.425802 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.425932 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.426109 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.426238 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.426413 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.426548 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.426714 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.426849 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.427026 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.427154 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.427325 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.427451 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.427624 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.427752 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.427932 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.428072 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.428244 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.428383 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.428549 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.428685 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.428856 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.428986 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.429162 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.429290 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.429479 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.429616 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.429814 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.429956 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.430124 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.430245 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.430453 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.430588 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.430760 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.430897 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.431070 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.431201 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.431376 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.431522 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.431682 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.431811 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.431987 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.432130 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.432332 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.432461 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.432584 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.432707 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.432861 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.432990 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.433234 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.433365 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.433489 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.433623 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.433771 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.433897 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.434033 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.434159 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.434330 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.434459 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.434620 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.434755 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.434912 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.435041 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.435212 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.435342 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.435528 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.435676 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.435832 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.435959 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.436131 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.436258 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.436427 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.436556 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.436726 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.436874 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.437088 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.437225 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.437392 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.437534 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.437768 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.437902 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.438085 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.438222 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.438407 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.438545 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.438720 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.438846 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.439026 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.439153 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.439337 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.439478 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.439644 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.439771 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.439952 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.440080 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.440259 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.440384 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.440567 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.440695 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.440913 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.441043 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.441176 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.441311 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.441491 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.441619 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.441821 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.441950 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.442152 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.442279 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.442482 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.442610 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.442733 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.442854 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.443025 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.443155 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.443335 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.443471 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.443670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.443814 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.443991 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.444118 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.444301 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.444434 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.444613 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.444750 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.444919 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.445053 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.445228 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.445355 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.445531 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.445672 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.445851 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.445985 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.446155 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.446284 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.446459 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.446597 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.446773 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.446911 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.447079 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.447214 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.447385 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.447520 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.447687 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.447814 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.448024 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.448197 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.448417 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.448621 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.448757 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.448909 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.449037 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.449216 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.449364 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.449531 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.449659 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.449884 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.450026 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.450197 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.450334 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.450552 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.450717 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.450848 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.451002 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.451130 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.451262 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.451412 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.451541 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.451716 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.451842 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.452023 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.452151 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.452325 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.452979 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.453178 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.453305 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.453437 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.453563 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.453763 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.453895 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.454074 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.454219 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.454381 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.454510 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.454683 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.454820 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.454994 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.455122 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.455298 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.455426 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.455597 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.455724 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.455897 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.456036 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.456203 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.456330 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.456516 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.456649 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.456822 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.456962 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.457127 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.457260 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.457434 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.457562 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.457740 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.457882 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.458060 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.458188 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.458378 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.458506 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.458681 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.458817 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.458982 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.459110 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.459284 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.459420 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.459584 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.459753 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.459910 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.460036 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.460214 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.460347 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.460513 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.460648 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.460823 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.460951 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.461139 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.461266 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.461443 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.461570 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.461771 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.461901 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.462078 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.462216 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.462383 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.462513 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.462693 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.462820 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.463000 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.463135 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.463340 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.463500 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.463642 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.463765 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.463910 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.464047 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.464216 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.464344 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.464529 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.464656 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.464848 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.464983 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.465166 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.465426 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.465553 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.465785 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.465916 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.466088 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.466223 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.466395 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.466529 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.466709 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.466840 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.467028 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.467359 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.467485 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.467689 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.467816 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.468011 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.468196 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.468421 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.468562 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.468739 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.468868 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.469049 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.469260 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.469389 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.469778 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.469943 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.470073 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.470255 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.470400 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.470564 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.470698 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.470871 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.471001 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.471170 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.471296 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.471470 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.471600 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.471775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.471909 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.472075 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.472201 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.472378 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.472507 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.472679 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.472807 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.472983 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.473110 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.473280 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.473491 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.473623 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.473854 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.473982 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.474121 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.474247 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.474377 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.474502 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.474625 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.474747 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.474879 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.475051 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.475187 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.475350 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.475485 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.475667 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.475807 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.475971 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.476099 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.476269 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.476397 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.476567 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.476703 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.476866 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.476996 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.477205 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.477333 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.477504 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.477639 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.477861 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.477992 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.478191 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.478319 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.478513 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.478640 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.478816 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.478942 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.479126 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.479254 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.479426 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.479555 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.479741 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.479868 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.480055 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.480182 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.480362 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.480491 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.480666 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.480785 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.480968 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.481108 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.481263 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.481398 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.481571 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.481704 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.481900 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.482039 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.482206 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.482333 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.482509 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.482634 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.482807 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.482941 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.483111 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.483246 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.483411 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.483617 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.484257 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.484383 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.484640 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.484861 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.484990 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.485168 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.485306 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.485472 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.485601 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.485816 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.485946 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.486148 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.486290 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.486417 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.486541 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.486728 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.486857 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.487030 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.487140 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.487341 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.487444 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.487648 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.487744 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.487951 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.488055 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.488252 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.488346 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.488556 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.488652 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.488861 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.488954 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.489159 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.489252 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.489467 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.489560 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.489792 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.489887 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.490094 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.490192 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.490391 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.490479 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.490694 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.490809 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.490993 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.491085 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.491291 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.491385 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.491593 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.491679 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.491911 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.492054 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.492216 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.492355 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.492514 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.492649 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.492818 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.492953 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.493116 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.493252 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.493416 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.493544 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.493791 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.493920 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.494045 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.494176 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.494301 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.494423 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.494606 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.494782 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.494916 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.495048 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.495262 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.495389 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.495560 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.495684 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.495883 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.496009 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.496166 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.496292 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.496464 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.496597 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.496764 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.496901 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.497063 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.497190 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.497398 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.497532 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.497699 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.497851 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.498039 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.498180 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.498357 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.498485 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.498666 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.498793 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.498977 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.499103 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.499283 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.499475 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.500138 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.500267 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.500464 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.500613 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.500781 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.500937 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.501097 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.501225 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.501422 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.501562 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.501769 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.501920 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.502101 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.502230 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.502410 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.502537 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.502720 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.502855 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.503026 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.503153 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.503331 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.503459 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.503641 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.503790 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.503990 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.504118 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.504241 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.504365 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.504548 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.504676 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.504851 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.504979 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.505156 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.505283 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.505459 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.505597 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.505786 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.505915 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.506092 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.506218 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.506399 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.506529 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.506706 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.506833 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.507011 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.507137 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.507317 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.507454 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.507621 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.507750 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.507927 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.508069 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.508232 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.508359 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.508534 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.508668 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.508834 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.508970 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.509153 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.509289 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.509458 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.509600 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.509922 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.510143 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.510335 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.510460 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.510585 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.510763 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.510946 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.511119 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.511294 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.511457 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.511731 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.512038 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.512341 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.512650 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.512806 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.512943 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.513140 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.513278 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.513459 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.513589 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.513860 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.514003 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.514239 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.514381 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.514561 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.514697 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.514868 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.515016 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.515201 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.515337 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.515503 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.515640 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.515801 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.515966 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.516179 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.516315 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.516491 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.516620 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.516802 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.516938 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.517110 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.517250 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.517411 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.517539 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.517759 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.517902 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.518062 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.518201 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.518380 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.518510 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.518782 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.518909 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.519090 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.519231 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.519392 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.519520 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.519800 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.519938 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.520108 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.520246 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.520413 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.520550 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.520728 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.520857 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.521045 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.521174 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.521356 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.521483 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.521656 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.521817 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.521991 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.522124 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.522295 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.522425 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.522610 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.522740 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.522926 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.523054 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.523231 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.523370 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.523537 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.523673 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.523835 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.523962 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.524152 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.524359 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.524495 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.524621 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.524745 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.524882 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.525065 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.525203 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.525473 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.525603 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.525826 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.525974 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.526135 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.526272 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.526453 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.526582 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.526768 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.526909 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.527067 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.527193 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.527369 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.527497 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.527674 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.527811 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.527980 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.528106 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.528278 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.528414 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.528596 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.528726 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.528896 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.529037 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.529204 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.529333 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.529510 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.529640 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.529836 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.529964 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.530136 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.530264 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.530435 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.530591 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.530775 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.530904 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.531076 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.531226 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.531430 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.531561 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.531686 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.531810 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.531995 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.532137 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.532312 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.532431 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.532613 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.532749 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.532930 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.533067 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.533238 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.533355 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.533553 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.533659 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.533861 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.533970 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.534163 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.534251 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.534498 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.534586 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.534800 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.534898 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.535115 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.535202 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.535438 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.535524 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.535756 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.535842 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.536061 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.536145 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.536391 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.536491 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.536712 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.536801 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.537025 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.537112 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.537338 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.537424 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.537645 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.537818 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.537977 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.538065 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.538277 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.538372 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.538583 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.538670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.538880 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.538974 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.539179 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.539280 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.539477 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.539564 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.539781 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.539867 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.540079 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.540175 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.540377 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.540465 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.540674 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.540760 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.540992 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.541087 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.541289 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.541383 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.541705 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.541905 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.542030 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.542113 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.542311 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.542470 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.542618 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.542756 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.542928 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.543073 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.543245 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.543396 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.543555 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.543699 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.543925 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.544066 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.544202 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.544339 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.544493 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.544704 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.544856 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.544994 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.545130 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.545265 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.545403 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.545553 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.545703 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.545867 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.546003 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.546151 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.546844 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.547001 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.547141 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.547285 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.547457 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.547613 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.547752 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.547896 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.548070 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.548226 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.548363 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.548500 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.548671 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.548831 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.548977 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.549114 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.549280 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.549556 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.549836 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.550008 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.550150 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.550294 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.550462 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.550683 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.550836 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.550983 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.551121 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.551258 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.551401 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.551538 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.551751 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.551901 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.552040 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.552176 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.552330 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.552480 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.552627 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.552765 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.552910 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.553055 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.553193 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.553337 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.553475 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.553612 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.553779 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.553970 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.554138 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.554287 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.554426 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.554601 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.554829 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.554981 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.555128 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.555267 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.555409 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.555572 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.555730 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.555884 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.556034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.556173 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.556309 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.556496 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.556641 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.556787 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.556925 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.557103 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.557255 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.557423 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.557567 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.557760 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.557947 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.558097 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.558234 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.558370 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.558504 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.558678 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.558825 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.558989 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.559133 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.559299 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.559458 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.559598 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.559790 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.559943 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.560081 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.560217 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.560362 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.560532 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.560678 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.560842 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.560986 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.561135 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.561281 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.561450 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.561594 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.562602 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.562760 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.562897 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.563046 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.563197 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.563342 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.563479 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.563615 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.563808 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.563955 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.564123 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.564269 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.564425 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.564562 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.564755 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.564979 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.565123 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.565267 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.565404 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.565539 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.565683 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.565878 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.566017 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.566167 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.566313 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.566462 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.566608 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.566745 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.566880 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.567015 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.567150 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.567295 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.567434 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.567577 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.567714 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.567850 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.568315 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.568475 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.568668 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.568815 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.568983 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.569126 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.569311 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.569466 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.569634 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.569809 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.569976 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.570130 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.570280 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.570487 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.570598 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.570843 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.570930 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.571176 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.571273 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.571488 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.571575 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.571796 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.571893 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.572095 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.572191 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.572394 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.572483 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.572707 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.572829 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.573096 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.573205 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.573401 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.573495 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.573710 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.573822 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.574034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.574127 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.574357 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.574455 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.574660 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.574753 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.574962 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.575055 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.575262 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.575360 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.575572 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.575662 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.575874 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.575964 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.576174 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.576263 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.576473 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.576563 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.576772 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.576870 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.577077 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.577175 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.577468 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.577626 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.577874 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.578039 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.578225 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.578357 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.578536 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.578668 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.578855 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.579016 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.579155 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.579291 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.579458 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.579605 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.579777 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.579916 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.580078 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.580232 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.580365 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.580542 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.580675 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.580848 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.580994 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.581164 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.581304 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.581519 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.581657 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.581832 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.581922 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.582108 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.582211 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.582419 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.582517 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.582768 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.583019 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.583127 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.583348 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.583664 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.583761 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.583994 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.584085 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.584320 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.584472 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.584617 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.584790 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.584932 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.585126 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.585283 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.585422 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.585557 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.585750 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.585862 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.586064 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.586165 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.586391 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.586482 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.586702 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.586793 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.587005 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.587104 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.587313 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.587403 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.587617 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.587756 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.587923 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.588066 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.588226 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.588357 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.588606 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.588734 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.588916 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.589056 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.589224 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.589352 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.589528 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.589663 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.589862 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.590003 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.590175 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.590303 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.590484 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.590623 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.590799 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.590931 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.591109 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.591238 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.591422 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.591563 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.591729 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.591867 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.592034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.592196 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.592334 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.592520 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.592651 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.592888 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.593032 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.593255 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.593393 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.593561 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.593691 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.593888 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.594183 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.594321 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.594856 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.594998 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.595193 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.595329 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.595496 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.595626 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.595805 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.595943 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.596122 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.596259 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.596439 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.596584 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.596748 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.596880 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.597066 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.597195 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.597374 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.597514 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.597699 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.597848 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.598057 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.598186 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.598381 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.598529 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.598702 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.598834 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.599003 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.599135 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.599305 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.599445 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.599608 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.599746 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.599912 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.600049 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.600226 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.600365 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.600532 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.600669 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.600830 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.600969 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.601128 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.601259 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.601433 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.601563 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.601748 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.601882 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.602050 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.602183 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.602349 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.602480 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.602648 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.602777 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.602949 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.603079 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.603249 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.603434 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.603586 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.603734 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.603879 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.604023 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.604195 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.604399 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.604491 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.604679 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.604818 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.604962 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.605053 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.605172 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.605335 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.605486 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.605631 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.605795 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.605928 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.606082 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.606212 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.606364 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.606501 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.606643 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.606823 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.606963 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.607148 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.607297 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.607520 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.607651 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.607786 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.607921 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.608068 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.608204 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.608341 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.608476 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.608647 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.609285 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.609504 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.609649 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.609854 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.609991 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.610212 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.610349 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.610518 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.610676 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.610847 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.611156 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.611299 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.611512 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.611650 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.611785 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.612053 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.612192 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.612429 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.612688 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.612827 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.613057 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.613234 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.613385 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.613671 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.613858 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.614016 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.614331 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.614419 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.614648 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.614744 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.614960 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.615048 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.615265 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.615355 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.615589 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.615690 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.615896 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.615985 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.616202 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.616289 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.616513 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.616614 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.616819 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.616907 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.617125 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.617219 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.617437 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.617540 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.617769 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.617881 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.618086 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.618173 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.618401 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.618498 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.618706 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.618792 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.619028 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.619113 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.619339 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.619428 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.619715 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.619803 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.620042 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.620131 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.620355 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.620445 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.620671 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.620757 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.620988 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.621085 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.621298 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.621384 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.621603 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.621690 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.621872 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 16:03:50.621978 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.622257 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.622581 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.622930 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.623251 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.623596 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.623923 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.624239 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.625107 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.625416 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:03:50.625662 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 16:03:50.683622 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO dbcounter [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] Registered counter for database nova_api Jun 16 16:03:50.689920 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO dbcounter [None req-6dc34fdc-6f22-4d18-a423-a6c4794ae10d None None] Registered counter for database nova_api Jun 16 16:03:50.705884 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_db.sqlalchemy.engines [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:03:50.709671 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG oslo_db.sqlalchemy.engines [None req-6dc34fdc-6f22-4d18-a423-a6c4794ae10d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:03:50.712733 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writer thread running {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:03:50.717000 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writer thread running {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:03:50.771340 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.context [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf72e9e5-e7ed-4e44-b62a-c0132a022092(cell1) {{(pid=103342) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 16:03:50.775548 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:03:50.777125 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:03:50.777957 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:03:50.778270 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.context [None req-6dc34fdc-6f22-4d18-a423-a6c4794ae10d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf72e9e5-e7ed-4e44-b62a-c0132a022092(cell1) {{(pid=103341) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 16:03:50.779922 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:03:50.782450 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO dbcounter [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] Registered counter for database nova_cell0 Jun 16 16:03:50.782896 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG oslo_concurrency.lockutils [None req-6dc34fdc-6f22-4d18-a423-a6c4794ae10d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:03:50.784456 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG oslo_concurrency.lockutils [None req-6dc34fdc-6f22-4d18-a423-a6c4794ae10d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:03:50.785273 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG oslo_concurrency.lockutils [None req-6dc34fdc-6f22-4d18-a423-a6c4794ae10d None None] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:03:50.786346 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO dbcounter [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] Registered counter for database nova_cell1 Jun 16 16:03:50.787253 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG oslo_concurrency.lockutils [None req-6dc34fdc-6f22-4d18-a423-a6c4794ae10d None None] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:03:50.789205 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO dbcounter [None req-6dc34fdc-6f22-4d18-a423-a6c4794ae10d None None] Registered counter for database nova_cell0 Jun 16 16:03:50.793420 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO dbcounter [None req-6dc34fdc-6f22-4d18-a423-a6c4794ae10d None None] Registered counter for database nova_cell1 Jun 16 16:03:50.793921 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_db.sqlalchemy.engines [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:03:50.796985 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_db.sqlalchemy.engines [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:03:50.801547 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG oslo_db.sqlalchemy.engines [None req-6dc34fdc-6f22-4d18-a423-a6c4794ae10d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:03:50.802959 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writer thread running {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:03:50.804365 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writer thread running {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:03:50.805324 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG oslo_db.sqlalchemy.engines [None req-6dc34fdc-6f22-4d18-a423-a6c4794ae10d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:03:50.806839 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writer thread running {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:03:50.954528 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writer thread running {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:03:50.963051 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO dbcounter [None req-6dc34fdc-6f22-4d18-a423-a6c4794ae10d None None] Registered counter for database nova_cell0 Jun 16 16:03:50.964134 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO dbcounter [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] Registered counter for database nova_cell0 Jun 16 16:03:50.972711 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG oslo_db.sqlalchemy.engines [None req-6dc34fdc-6f22-4d18-a423-a6c4794ae10d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:03:50.976160 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_db.sqlalchemy.engines [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:03:50.977031 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writer thread running {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:03:50.980681 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writer thread running {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:03:51.311854 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: WARNING keystonemiddleware.auth_token [None req-6dc34fdc-6f22-4d18-a423-a6c4794ae10d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:03:51.313416 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: WARNING keystonemiddleware.auth_token [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:03:51.319169 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: WARNING keystonemiddleware.auth_token [None req-6dc34fdc-6f22-4d18-a423-a6c4794ae10d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:03:51.320568 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: WARNING keystonemiddleware.auth_token [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:03:51.661591 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: WARNING keystonemiddleware.auth_token [None req-6dc34fdc-6f22-4d18-a423-a6c4794ae10d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:03:51.662547 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: WARNING keystonemiddleware.auth_token [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:03:51.667524 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: WARNING keystonemiddleware.auth_token [None req-6dc34fdc-6f22-4d18-a423-a6c4794ae10d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:03:51.668406 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: WARNING keystonemiddleware.auth_token [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:03:51.672806 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558ede1589c0 pid: 103341 (default app) Jun 16 16:03:51.673733 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558ede1589c0 pid: 103342 (default app) Jun 16 16:03:51.674885 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-6dc34fdc-6f22-4d18-a423-a6c4794ae10d None None] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:03:51.676066 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-6dc34fdc-6f22-4d18-a423-a6c4794ae10d None None] 10.222.0.88 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001711 Jun 16 16:03:51.676462 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 1/1] 10.222.0.88 () {50 vars in 788 bytes} [Thu Jun 16 16:03:51 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:05:08.830178 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:08.831322 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001982 Jun 16 16:05:08.831729 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 1/2] 10.222.0.88 () {54 vars in 930 bytes} [Thu Jun 16 16:05:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:05:08.848498 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writing DB stats nova_api:SELECT=3 {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:08.849786 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writing DB stats nova_cell0:SELECT=3 {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:08.850613 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writing DB stats nova_cell1:SELECT=3 {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:08.851630 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:09.342616 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-3a107e97-e406-47da-a626-38f5648c4ac8 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:09.376201 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-3a107e97-e406-47da-a626-38f5648c4ac8 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.538061 Jun 16 16:05:09.376744 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 2/3] 10.222.0.88 () {60 vars in 1291 bytes} [Thu Jun 16 16:05:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:05:11.598591 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:11.599608 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-a4e0e840-4243-478c-b96b-d5e7b676886e None None] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jun 16 16:05:11.600262 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 2/4] 10.222.0.88 () {54 vars in 930 bytes} [Thu Jun 16 16:05:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:05:11.669749 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-99e87527-72b3-4758-a493-e12965438a28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "id": "c1", "rxtx_factor": 1.0, "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:11.688500 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:05:11.688500 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: warnings.warn(msg) Jun 16 16:05:11.718059 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-99e87527-72b3-4758-a493-e12965438a28 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.110939 Jun 16 16:05:11.718623 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 3/5] 10.222.0.88 () {64 vars in 1282 bytes} [Thu Jun 16 16:05:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:05:11.734388 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_api:SELECT=3 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:11.735500 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_cell0:SELECT=3 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:11.736422 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_cell1:SELECT=3 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:11.737538 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:11.954530 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-110b9a55-30c7-46cc-a489-30b95c49441f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:11.957217 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:05:11.957217 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: warnings.warn(msg) Jun 16 16:05:12.023177 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-110b9a55-30c7-46cc-a489-30b95c49441f admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.295790 Jun 16 16:05:12.024108 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 3/6] 10.222.0.88 () {64 vars in 1335 bytes} [Thu Jun 16 16:05:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:05:14.214260 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-99e87527-72b3-4758-a493-e12965438a28 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:14.215286 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-99e87527-72b3-4758-a493-e12965438a28 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jun 16 16:05:14.216322 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 4/7] 10.222.0.88 () {54 vars in 930 bytes} [Thu Jun 16 16:05:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:05:14.330751 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-7fd1d5cc-6c30-4bf0-b757-dedddc3d0da5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 5, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "ram": 512, "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:14.350039 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:05:14.350039 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: warnings.warn(msg) Jun 16 16:05:14.369416 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-7fd1d5cc-6c30-4bf0-b757-dedddc3d0da5 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146234 Jun 16 16:05:14.370015 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 4/8] 10.222.0.88 () {64 vars in 1282 bytes} [Thu Jun 16 16:05:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:05:14.383245 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-32d347b2-20c8-4514-b63b-38ca821ff88f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:14.385079 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:05:14.385079 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: warnings.warn(msg) Jun 16 16:05:14.426685 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-32d347b2-20c8-4514-b63b-38ca821ff88f admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044228 Jun 16 16:05:14.426685 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 5/9] 10.222.0.88 () {64 vars in 1335 bytes} [Thu Jun 16 16:05:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:05:16.656083 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-7fd1d5cc-6c30-4bf0-b757-dedddc3d0da5 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:16.657676 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-7fd1d5cc-6c30-4bf0-b757-dedddc3d0da5 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002034 Jun 16 16:05:16.658269 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 5/10] 10.222.0.88 () {54 vars in 930 bytes} [Thu Jun 16 16:05:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:05:16.731939 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-ce261785-e4c6-4fde-9457-17dac22e7122 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d2", "vcpus": 1, "ram": 1024, "swap": 0, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:16.751246 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-ce261785-e4c6-4fde-9457-17dac22e7122 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087026 Jun 16 16:05:16.751912 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 6/11] 10.222.0.88 () {64 vars in 1282 bytes} [Thu Jun 16 16:05:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:05:16.767918 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-fb23dab0-dac4-4e2a-9134-f94c01197d0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:16.793084 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-fb23dab0-dac4-4e2a-9134-f94c01197d0d admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032646 Jun 16 16:05:16.801773 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 6/12] 10.222.0.88 () {64 vars in 1335 bytes} [Thu Jun 16 16:05:16 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:05:19.055522 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-ce261785-e4c6-4fde-9457-17dac22e7122 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:19.056554 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-ce261785-e4c6-4fde-9457-17dac22e7122 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jun 16 16:05:19.057147 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 7/13] 10.222.0.88 () {54 vars in 930 bytes} [Thu Jun 16 16:05:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:05:19.127040 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-9dd11d5d-d647-4494-82c4-ac4797908915 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:19.150821 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-9dd11d5d-d647-4494-82c4-ac4797908915 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.086965 Jun 16 16:05:19.151391 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 7/14] 10.222.0.88 () {64 vars in 1282 bytes} [Thu Jun 16 16:05:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:05:19.163512 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-4621b8f1-1770-45a5-9bb2-cc321c4fa759 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:19.192290 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-4621b8f1-1770-45a5-9bb2-cc321c4fa759 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032764 Jun 16 16:05:19.192877 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 8/15] 10.222.0.88 () {64 vars in 1335 bytes} [Thu Jun 16 16:05:19 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:05:21.446395 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-9dd11d5d-d647-4494-82c4-ac4797908915 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:21.448493 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-9dd11d5d-d647-4494-82c4-ac4797908915 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002585 Jun 16 16:05:21.449108 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 8/16] 10.222.0.88 () {54 vars in 930 bytes} [Thu Jun 16 16:05:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:05:21.534313 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-a76d5c63-dbbf-433c-b2ff-20daf050ae5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "id": "d4", "disk": 20, "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:21.553400 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-a76d5c63-dbbf-433c-b2ff-20daf050ae5a admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.096527 Jun 16 16:05:21.554282 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 9/17] 10.222.0.88 () {64 vars in 1282 bytes} [Thu Jun 16 16:05:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:05:21.566624 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-88ad36eb-0595-414d-8fe2-88890918fcc4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:21.591359 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-88ad36eb-0595-414d-8fe2-88890918fcc4 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028077 Jun 16 16:05:21.592032 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 9/18] 10.222.0.88 () {64 vars in 1335 bytes} [Thu Jun 16 16:05:21 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:05:23.785700 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-a76d5c63-dbbf-433c-b2ff-20daf050ae5a admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:23.787325 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-a76d5c63-dbbf-433c-b2ff-20daf050ae5a admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002043 Jun 16 16:05:23.787734 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 10/19] 10.222.0.88 () {54 vars in 930 bytes} [Thu Jun 16 16:05:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:05:23.849140 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-80cd1eb9-d105-4382-9190-bc7211be554a admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:23.880967 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-80cd1eb9-d105-4382-9190-bc7211be554a admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086963 Jun 16 16:05:23.881882 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 10/20] 10.222.0.88 () {60 vars in 1291 bytes} [Thu Jun 16 16:05:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:05:26.236428 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-a76d5c63-dbbf-433c-b2ff-20daf050ae5a admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:26.237497 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-a76d5c63-dbbf-433c-b2ff-20daf050ae5a admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Jun 16 16:05:26.237946 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 11/21] 10.222.0.88 () {54 vars in 930 bytes} [Thu Jun 16 16:05:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:05:26.303448 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-aedbe22d-7780-4b3d-bdf7-c007b9fe4e7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "swap": 0, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:26.325324 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-aedbe22d-7780-4b3d-bdf7-c007b9fe4e7e admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080686 Jun 16 16:05:26.325955 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 11/22] 10.222.0.88 () {64 vars in 1282 bytes} [Thu Jun 16 16:05:26 2022] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 16:05:26.338305 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-9e5f967b-6b97-4eb7-bc64-d801a152b27f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:26.363952 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-9e5f967b-6b97-4eb7-bc64-d801a152b27f admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029586 Jun 16 16:05:26.364569 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 12/23] 10.222.0.88 () {64 vars in 1332 bytes} [Thu Jun 16 16:05:26 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:05:28.664428 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-aedbe22d-7780-4b3d-bdf7-c007b9fe4e7e admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:28.665500 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-aedbe22d-7780-4b3d-bdf7-c007b9fe4e7e admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 Jun 16 16:05:28.666028 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 12/24] 10.222.0.88 () {54 vars in 930 bytes} [Thu Jun 16 16:05:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:05:28.739069 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-b35bb79b-0f62-43f2-a733-a94654db6ab0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "name": "m1.small", "vcpus": 1, "rxtx_factor": 1.0, "id": "2", "ram": 2048}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:28.758378 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-b35bb79b-0f62-43f2-a733-a94654db6ab0 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084020 Jun 16 16:05:28.758970 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 13/25] 10.222.0.88 () {64 vars in 1282 bytes} [Thu Jun 16 16:05:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 16:05:28.771574 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-c31735f7-ba0f-407d-b00e-84a19c99417f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:28.797052 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-c31735f7-ba0f-407d-b00e-84a19c99417f admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029525 Jun 16 16:05:28.797695 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 13/26] 10.222.0.88 () {64 vars in 1332 bytes} [Thu Jun 16 16:05:28 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:05:31.083509 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-b35bb79b-0f62-43f2-a733-a94654db6ab0 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:31.084573 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-b35bb79b-0f62-43f2-a733-a94654db6ab0 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jun 16 16:05:31.084995 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 14/27] 10.222.0.88 () {54 vars in 930 bytes} [Thu Jun 16 16:05:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:05:31.165480 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-a5536bc7-b867-450a-b1f4-8646d33612e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "disk": 40, "swap": 0}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:31.183874 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-a5536bc7-b867-450a-b1f4-8646d33612e2 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.092005 Jun 16 16:05:31.184431 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 14/28] 10.222.0.88 () {64 vars in 1282 bytes} [Thu Jun 16 16:05:31 2022] POST /compute/v2.1/flavors => generated 406 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:05:31.196642 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-dee11534-0115-4da7-ab2c-37d7bac859d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:31.219927 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-dee11534-0115-4da7-ab2c-37d7bac859d2 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026928 Jun 16 16:05:31.220767 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 15/29] 10.222.0.88 () {64 vars in 1332 bytes} [Thu Jun 16 16:05:31 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:05:33.393256 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-a5536bc7-b867-450a-b1f4-8646d33612e2 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:33.394272 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-a5536bc7-b867-450a-b1f4-8646d33612e2 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 16 16:05:33.394668 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 15/30] 10.222.0.88 () {54 vars in 930 bytes} [Thu Jun 16 16:05:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:05:33.455493 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-91e75100-8806-4ac5-8c4d-fc644263e700 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "disk": 80, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:33.474778 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-91e75100-8806-4ac5-8c4d-fc644263e700 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074138 Jun 16 16:05:33.475364 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 16/31] 10.222.0.88 () {64 vars in 1282 bytes} [Thu Jun 16 16:05:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:05:33.487751 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-355231be-1a2a-4250-80c8-f8556bbbc948 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:33.512203 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-355231be-1a2a-4250-80c8-f8556bbbc948 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027637 Jun 16 16:05:33.512829 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 16/32] 10.222.0.88 () {64 vars in 1332 bytes} [Thu Jun 16 16:05:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:05:35.747222 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-91e75100-8806-4ac5-8c4d-fc644263e700 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:05:35.748424 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-91e75100-8806-4ac5-8c4d-fc644263e700 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 16 16:05:35.749045 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 17/33] 10.222.0.88 () {54 vars in 930 bytes} [Thu Jun 16 16:05:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:05:35.814390 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-fbd20dec-74b3-419d-b631-cfeb47173f06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "swap": 0, "vcpus": 8, "name": "m1.xlarge", "disk": 160}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:35.832871 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-fbd20dec-74b3-419d-b631-cfeb47173f06 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076530 Jun 16 16:05:35.833766 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 17/34] 10.222.0.88 () {64 vars in 1282 bytes} [Thu Jun 16 16:05:35 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 16:05:35.846170 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-8cb2ba91-dbef-4f93-9b0b-52f2e5ea1364 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:05:35.871552 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-8cb2ba91-dbef-4f93-9b0b-52f2e5ea1364 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028721 Jun 16 16:05:35.872077 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 18/35] 10.222.0.88 () {64 vars in 1332 bytes} [Thu Jun 16 16:05:35 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:06:00.380511 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-fbd20dec-74b3-419d-b631-cfeb47173f06 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:00.381516 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-fbd20dec-74b3-419d-b631-cfeb47173f06 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 16 16:06:00.382005 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 18/36] 10.222.0.88 () {54 vars in 930 bytes} [Thu Jun 16 16:06:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:06:00.393412 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:00.446579 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-71f6732c-b82a-43b8-98ef-aa9f591e6700 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:00.463807 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-71f6732c-b82a-43b8-98ef-aa9f591e6700 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075138 Jun 16 16:06:00.464382 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 19/37] 10.222.0.88 () {60 vars in 1291 bytes} [Thu Jun 16 16:06:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:06:01.444594 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-fbd20dec-74b3-419d-b631-cfeb47173f06 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:01.446777 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-fbd20dec-74b3-419d-b631-cfeb47173f06 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003417 Jun 16 16:06:01.447972 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 19/38] 10.222.0.88 () {56 vars in 1074 bytes} [Thu Jun 16 16:06:01 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:06:01.642875 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-a40519b2-489a-43b2-841f-e46b0fd30fe6 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:01.648474 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.wsgi [None req-a40519b2-489a-43b2-841f-e46b0fd30fe6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-a40519b2-489a-43b2-841f-e46b0fd30fe6 admin admin] Request method failure captured: Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Accept: application/json Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Accept-Encoding: gzip, deflate Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Connection: keep-alive Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Content-Length: 0 Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Host: 10.222.0.88 Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Openstack-Api-Version: compute 2.90 Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Openstack-System-Scope: None Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: User-Agent: python-novaclient Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Auth-Token: gAAAAABiq1TpeUlI7vQc8R4T5HxeyONsEXlh-YDDAJAYpeUsi5itQ2SdUS4MG0L42tzxOY6Qfnz1mFkVo_C9LU2iLYHXampWC5pP_e_hN1bkni5J45Lfa8mfzP7a9ehR44WmsZPecyaAGGNFjhbsElzR6rgWNiroNLE2thAfotIo0nZoqA_JutM Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Domain-Id: None Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Domain-Name: None Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Identity-Status: Confirmed Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Is-Admin-Project: True Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Project-Domain-Id: default Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Project-Domain-Name: Default Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Project-Id: a913cabdc8c6449f971e776cd4ba8813 Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Project-Name: admin Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Role: reader,member,admin Jun 16 16:06:01.652352 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Roles: reader,member,admin Jun 16 16:06:01.654674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a913cabdc8c6449f971e776cd4ba8813"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a913cabdc8c6449f971e776cd4ba8813"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a913cabdc8c6449f971e776cd4ba8813", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a913cabdc8c6449f971e776cd4ba8813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:06:01.654674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Tenant: admin Jun 16 16:06:01.654674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Tenant-Id: a913cabdc8c6449f971e776cd4ba8813 Jun 16 16:06:01.654674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Tenant-Name: admin Jun 16 16:06:01.654674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-User: admin Jun 16 16:06:01.654674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-User-Domain-Id: default Jun 16 16:06:01.654674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-User-Domain-Name: Default Jun 16 16:06:01.654674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-User-Id: fded449262ae4659b5d91d4b0bc2b7a0 Jun 16 16:06:01.654674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-User-Name: admin Jun 16 16:06:01.654674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: method: > Jun 16 16:06:01.654674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: exception: Flavor 42 could not be found. Jun 16 16:06:01.654674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: action_args: {'id': '42'} Jun 16 16:06:01.654674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:06:01.654674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:06:01.655922 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 16:06:01.655922 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 16:06:01.655922 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 16:06:01.655922 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 16:06:01.655922 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:06:01.655922 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:06:01.655922 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 16:06:01.655922 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 16:06:01.655922 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 16:06:01.655922 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:06:01.655922 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 16:06:01.655922 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 16:06:01.655922 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 16:06:01.655922 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 16 16:06:01.655922 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:06:01.655922 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 16 16:06:01.655922 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:06:01.655922 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:06:01.655922 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:06:01.657501 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:06:01.657501 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:06:01.657501 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:06:01.657501 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:06:01.657501 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 16:06:01.657501 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:06:01.657501 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 16:06:01.657501 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 16 16:06:01.657501 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:06:01.657501 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 16 16:06:01.657501 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:06:01.657501 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:06:01.657501 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:06:01.657501 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:06:01.657501 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:06:01.657501 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 16:06:01.657501 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 16 16:06:01.657501 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-a40519b2-489a-43b2-841f-e46b0fd30fe6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:06:01.659125 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-a40519b2-489a-43b2-841f-e46b0fd30fe6 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062790 Jun 16 16:06:01.659125 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 20/39] 10.222.0.88 () {60 vars in 1190 bytes} [Thu Jun 16 16:06:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 16:06:01.665318 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-e8a33904-80fb-4a06-9441-4f06f6032dc1 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:01.669027 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:01.688362 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-e8a33904-80fb-4a06-9441-4f06f6032dc1 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026668 Jun 16 16:06:01.688915 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 20/40] 10.222.0.88 () {60 vars in 1210 bytes} [Thu Jun 16 16:06:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:06:01.699346 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-3f9ce9e6-a15f-42d7-ae95-810d824ef912 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:01.720708 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-3f9ce9e6-a15f-42d7-ae95-810d824ef912 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025322 Jun 16 16:06:01.721266 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 21/41] 10.222.0.88 () {60 vars in 1210 bytes} [Thu Jun 16 16:06:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:06:01.731625 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-9007274e-f031-4996-852e-9dbd3c01869e admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:01.738185 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.wsgi [None req-9007274e-f031-4996-852e-9dbd3c01869e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-9007274e-f031-4996-852e-9dbd3c01869e admin admin] Request method failure captured: Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Accept: application/json Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Accept-Encoding: gzip, deflate Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Connection: keep-alive Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Content-Length: 0 Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Host: 10.222.0.88 Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Openstack-Api-Version: compute 2.90 Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Openstack-System-Scope: None Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: User-Agent: python-novaclient Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Auth-Token: gAAAAABiq1TpeUlI7vQc8R4T5HxeyONsEXlh-YDDAJAYpeUsi5itQ2SdUS4MG0L42tzxOY6Qfnz1mFkVo_C9LU2iLYHXampWC5pP_e_hN1bkni5J45Lfa8mfzP7a9ehR44WmsZPecyaAGGNFjhbsElzR6rgWNiroNLE2thAfotIo0nZoqA_JutM Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Domain-Id: None Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Domain-Name: None Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Identity-Status: Confirmed Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Is-Admin-Project: True Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Project-Domain-Id: default Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Project-Domain-Name: Default Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Project-Id: a913cabdc8c6449f971e776cd4ba8813 Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Project-Name: admin Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Role: reader,member,admin Jun 16 16:06:01.741419 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Roles: reader,member,admin Jun 16 16:06:01.743126 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a913cabdc8c6449f971e776cd4ba8813"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a913cabdc8c6449f971e776cd4ba8813"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a913cabdc8c6449f971e776cd4ba8813", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a913cabdc8c6449f971e776cd4ba8813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:06:01.743126 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Tenant: admin Jun 16 16:06:01.743126 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Tenant-Id: a913cabdc8c6449f971e776cd4ba8813 Jun 16 16:06:01.743126 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Tenant-Name: admin Jun 16 16:06:01.743126 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-User: admin Jun 16 16:06:01.743126 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-User-Domain-Id: default Jun 16 16:06:01.743126 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-User-Domain-Name: Default Jun 16 16:06:01.743126 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-User-Id: fded449262ae4659b5d91d4b0bc2b7a0 Jun 16 16:06:01.743126 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-User-Name: admin Jun 16 16:06:01.743126 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: method: > Jun 16 16:06:01.743126 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: exception: Flavor 42 could not be found. Jun 16 16:06:01.743126 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: action_args: {'id': '42'} Jun 16 16:06:01.743126 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:06:01.743126 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:06:01.744250 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 16:06:01.744250 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 16:06:01.744250 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 16:06:01.744250 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 16:06:01.744250 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:06:01.744250 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:06:01.744250 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 16:06:01.744250 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 16:06:01.744250 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 16:06:01.744250 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:06:01.744250 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 16:06:01.744250 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 16:06:01.744250 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 16:06:01.744250 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 16 16:06:01.744250 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:06:01.744250 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 16 16:06:01.744250 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:06:01.744250 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:06:01.744250 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:06:01.746224 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:06:01.746224 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:06:01.746224 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:06:01.746224 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:06:01.746224 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 16:06:01.746224 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:06:01.746224 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 16:06:01.746224 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 16 16:06:01.746224 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:06:01.746224 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 16 16:06:01.746224 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:06:01.746224 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:06:01.746224 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:06:01.746224 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:06:01.746224 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:06:01.746224 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 16:06:01.746224 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 16 16:06:01.746224 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-9007274e-f031-4996-852e-9dbd3c01869e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:06:01.747723 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-9007274e-f031-4996-852e-9dbd3c01869e admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015755 Jun 16 16:06:01.747723 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 21/42] 10.222.0.88 () {60 vars in 1190 bytes} [Thu Jun 16 16:06:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 16:06:02.625147 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-3f9ce9e6-a15f-42d7-ae95-810d824ef912 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:02.626202 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-3f9ce9e6-a15f-42d7-ae95-810d824ef912 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jun 16 16:06:02.626599 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 22/43] 10.222.0.88 () {56 vars in 1074 bytes} [Thu Jun 16 16:06:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:06:02.821677 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-9873e9b9-53ff-45ba-acd6-99def4abfa83 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:02.827164 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.wsgi [None req-9873e9b9-53ff-45ba-acd6-99def4abfa83 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-9873e9b9-53ff-45ba-acd6-99def4abfa83 admin admin] Request method failure captured: Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Accept: application/json Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Accept-Encoding: gzip, deflate Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Connection: keep-alive Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Content-Length: 0 Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Host: 10.222.0.88 Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Openstack-Api-Version: compute 2.90 Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Openstack-System-Scope: None Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: User-Agent: python-novaclient Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Auth-Token: gAAAAABiq1TqHaEJ5-sc26-7n515fUMq4QxwCf7GRXVrwMcuVK_XopYp8WWaPpGZ2Ygld0BqGvMbVLvnRr6NLsI2yMf6oUS5hX_iKJxNSa6AzVr67GwdM90cDH08LHPrh-i3idzAH1aFaRX1aWXXKMTNYFcrDuQudt1mofXAX4fvEss8_HHEf18 Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Domain-Id: None Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Domain-Name: None Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Identity-Status: Confirmed Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Is-Admin-Project: True Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Project-Domain-Id: default Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Project-Domain-Name: Default Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Project-Id: a913cabdc8c6449f971e776cd4ba8813 Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Project-Name: admin Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Role: reader,member,admin Jun 16 16:06:02.828670 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Roles: reader,member,admin Jun 16 16:06:02.830235 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a913cabdc8c6449f971e776cd4ba8813"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a913cabdc8c6449f971e776cd4ba8813"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a913cabdc8c6449f971e776cd4ba8813", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a913cabdc8c6449f971e776cd4ba8813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:06:02.830235 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Tenant: admin Jun 16 16:06:02.830235 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Tenant-Id: a913cabdc8c6449f971e776cd4ba8813 Jun 16 16:06:02.830235 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Tenant-Name: admin Jun 16 16:06:02.830235 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-User: admin Jun 16 16:06:02.830235 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-User-Domain-Id: default Jun 16 16:06:02.830235 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-User-Domain-Name: Default Jun 16 16:06:02.830235 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-User-Id: fded449262ae4659b5d91d4b0bc2b7a0 Jun 16 16:06:02.830235 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-User-Name: admin Jun 16 16:06:02.830235 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: method: > Jun 16 16:06:02.830235 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: exception: Flavor 84 could not be found. Jun 16 16:06:02.830235 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: action_args: {'id': '84'} Jun 16 16:06:02.830235 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:06:02.830235 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:06:02.831034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 16:06:02.831034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 16:06:02.831034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 16:06:02.831034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 16:06:02.831034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:06:02.831034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:06:02.831034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 16:06:02.831034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 16:06:02.831034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 16:06:02.831034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:06:02.831034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 16:06:02.831034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 16:06:02.831034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 16:06:02.831034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 16 16:06:02.831034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:06:02.831034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 16 16:06:02.831034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:06:02.831034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:06:02.831034 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:06:02.832266 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:06:02.832266 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:06:02.832266 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:06:02.832266 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:06:02.832266 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 16:06:02.832266 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:06:02.832266 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 16:06:02.832266 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 16 16:06:02.832266 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:06:02.832266 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 16 16:06:02.832266 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:06:02.832266 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:06:02.832266 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:06:02.832266 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:06:02.832266 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:06:02.832266 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 16:06:02.832266 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 16 16:06:02.832266 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-9873e9b9-53ff-45ba-acd6-99def4abfa83 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:06:02.833547 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-9873e9b9-53ff-45ba-acd6-99def4abfa83 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.064666 Jun 16 16:06:02.833547 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 22/44] 10.222.0.88 () {60 vars in 1190 bytes} [Thu Jun 16 16:06:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 16:06:02.846304 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-8c637c37-557a-4542-9a78-ec62bc91d22a admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:02.870861 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-8c637c37-557a-4542-9a78-ec62bc91d22a admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031479 Jun 16 16:06:02.871804 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 23/45] 10.222.0.88 () {60 vars in 1210 bytes} [Thu Jun 16 16:06:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:06:02.882597 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-eb48c5e7-4a75-4064-8ad9-c5c194375735 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:02.898055 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-eb48c5e7-4a75-4064-8ad9-c5c194375735 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018885 Jun 16 16:06:02.898573 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 23/46] 10.222.0.88 () {60 vars in 1210 bytes} [Thu Jun 16 16:06:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:06:02.908684 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-14fd252d-b616-4554-9b89-a01828050608 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:02.914264 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.wsgi [None req-14fd252d-b616-4554-9b89-a01828050608 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-14fd252d-b616-4554-9b89-a01828050608 admin admin] Request method failure captured: Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Accept: application/json Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Accept-Encoding: gzip, deflate Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Connection: keep-alive Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Content-Length: 0 Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Host: 10.222.0.88 Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Openstack-Api-Version: compute 2.90 Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Openstack-System-Scope: None Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: User-Agent: python-novaclient Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Auth-Token: gAAAAABiq1TqHaEJ5-sc26-7n515fUMq4QxwCf7GRXVrwMcuVK_XopYp8WWaPpGZ2Ygld0BqGvMbVLvnRr6NLsI2yMf6oUS5hX_iKJxNSa6AzVr67GwdM90cDH08LHPrh-i3idzAH1aFaRX1aWXXKMTNYFcrDuQudt1mofXAX4fvEss8_HHEf18 Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Domain-Id: None Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Domain-Name: None Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Identity-Status: Confirmed Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Is-Admin-Project: True Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Project-Domain-Id: default Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Project-Domain-Name: Default Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Project-Id: a913cabdc8c6449f971e776cd4ba8813 Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Project-Name: admin Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Role: reader,member,admin Jun 16 16:06:02.915775 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Roles: reader,member,admin Jun 16 16:06:02.917758 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a913cabdc8c6449f971e776cd4ba8813"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a913cabdc8c6449f971e776cd4ba8813"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a913cabdc8c6449f971e776cd4ba8813", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a913cabdc8c6449f971e776cd4ba8813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:06:02.917758 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Tenant: admin Jun 16 16:06:02.917758 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Tenant-Id: a913cabdc8c6449f971e776cd4ba8813 Jun 16 16:06:02.917758 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Tenant-Name: admin Jun 16 16:06:02.917758 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-User: admin Jun 16 16:06:02.917758 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-User-Domain-Id: default Jun 16 16:06:02.917758 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-User-Domain-Name: Default Jun 16 16:06:02.917758 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-User-Id: fded449262ae4659b5d91d4b0bc2b7a0 Jun 16 16:06:02.917758 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-User-Name: admin Jun 16 16:06:02.917758 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: method: > Jun 16 16:06:02.917758 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: exception: Flavor 84 could not be found. Jun 16 16:06:02.917758 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: action_args: {'id': '84'} Jun 16 16:06:02.917758 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:06:02.917758 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:06:02.918674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 16:06:02.918674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 16:06:02.918674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 16:06:02.918674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 16:06:02.918674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:06:02.918674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:06:02.918674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 16:06:02.918674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 16:06:02.918674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 16:06:02.918674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:06:02.918674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 16:06:02.918674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 16:06:02.918674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 16:06:02.918674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 16 16:06:02.918674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:06:02.918674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 16 16:06:02.918674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:06:02.918674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:06:02.918674 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:06:02.919731 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:06:02.919731 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:06:02.919731 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:06:02.919731 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:06:02.919731 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 16:06:02.919731 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:06:02.919731 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 16:06:02.919731 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 16 16:06:02.919731 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:06:02.919731 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 16 16:06:02.919731 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:06:02.919731 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:06:02.919731 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:06:02.919731 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:06:02.919731 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:06:02.919731 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 16:06:02.919731 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 16 16:06:02.919731 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-14fd252d-b616-4554-9b89-a01828050608 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:06:02.920742 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-14fd252d-b616-4554-9b89-a01828050608 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012109 Jun 16 16:06:02.920742 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 24/47] 10.222.0.88 () {60 vars in 1190 bytes} [Thu Jun 16 16:06:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 16:06:03.796079 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-eb48c5e7-4a75-4064-8ad9-c5c194375735 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:03.797083 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-eb48c5e7-4a75-4064-8ad9-c5c194375735 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 16 16:06:03.797480 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 24/48] 10.222.0.88 () {56 vars in 1074 bytes} [Thu Jun 16 16:06:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:06:03.990406 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-0f7c8f4e-a526-4f76-a6b3-faf4aa6b1714 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:03.996301 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.wsgi [None req-0f7c8f4e-a526-4f76-a6b3-faf4aa6b1714 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-0f7c8f4e-a526-4f76-a6b3-faf4aa6b1714 admin admin] Request method failure captured: Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Accept: application/json Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Accept-Encoding: gzip, deflate Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Connection: keep-alive Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Content-Length: 0 Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Host: 10.222.0.88 Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Openstack-Api-Version: compute 2.90 Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Openstack-System-Scope: None Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: User-Agent: python-novaclient Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Auth-Token: gAAAAABiq1TrerdTdYvqyxO3rXWrnlwGrn9TCaIbA3YQLkI-0neff1dwrAM5H0UsoAbAFLH6DdKHkPBONosWBVsdGLC7W24O2SOysYfMxIXPJHcrgR9xGsn1254K85R0BofNqkxkZuWnpdYgUJMLLwPOBZ1FfchV0U6rljnQhy9XZep255kfILs Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Domain-Id: None Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Domain-Name: None Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Identity-Status: Confirmed Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Is-Admin-Project: True Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Project-Domain-Id: default Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Project-Domain-Name: Default Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Project-Id: a913cabdc8c6449f971e776cd4ba8813 Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Project-Name: admin Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Role: reader,member,admin Jun 16 16:06:03.997845 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Roles: reader,member,admin Jun 16 16:06:03.999377 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a913cabdc8c6449f971e776cd4ba8813"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a913cabdc8c6449f971e776cd4ba8813"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a913cabdc8c6449f971e776cd4ba8813", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a913cabdc8c6449f971e776cd4ba8813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:06:03.999377 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Tenant: admin Jun 16 16:06:03.999377 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Tenant-Id: a913cabdc8c6449f971e776cd4ba8813 Jun 16 16:06:03.999377 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-Tenant-Name: admin Jun 16 16:06:03.999377 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-User: admin Jun 16 16:06:03.999377 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-User-Domain-Id: default Jun 16 16:06:03.999377 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-User-Domain-Name: Default Jun 16 16:06:03.999377 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-User-Id: fded449262ae4659b5d91d4b0bc2b7a0 Jun 16 16:06:03.999377 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: X-User-Name: admin Jun 16 16:06:03.999377 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: method: > Jun 16 16:06:03.999377 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: exception: Flavor 451 could not be found. Jun 16 16:06:03.999377 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: action_args: {'id': '451'} Jun 16 16:06:03.999377 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:06:03.999377 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:06:04.000211 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 16:06:04.000211 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 16:06:04.000211 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 16:06:04.000211 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 16:06:04.000211 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:06:04.000211 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:06:04.000211 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 16:06:04.000211 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 16:06:04.000211 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 16:06:04.000211 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:06:04.000211 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 16:06:04.000211 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 16:06:04.000211 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 16:06:04.000211 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 16 16:06:04.000211 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:06:04.000211 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 16 16:06:04.000211 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:06:04.000211 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:06:04.000211 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:06:04.002218 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:06:04.002218 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:06:04.002218 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:06:04.002218 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:06:04.002218 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 16:06:04.002218 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:06:04.002218 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 16:06:04.002218 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 16 16:06:04.002218 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:06:04.002218 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 16 16:06:04.002218 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:06:04.002218 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:06:04.002218 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:06:04.002218 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:06:04.002218 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:06:04.002218 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 16:06:04.002218 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Jun 16 16:06:04.002218 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-0f7c8f4e-a526-4f76-a6b3-faf4aa6b1714 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:06:04.004452 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-0f7c8f4e-a526-4f76-a6b3-faf4aa6b1714 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063055 Jun 16 16:06:04.004452 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 25/49] 10.222.0.88 () {60 vars in 1193 bytes} [Thu Jun 16 16:06:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 16:06:04.009218 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-bd12ff71-4b04-462b-8485-fc7d5f3b9266 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:04.025210 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-bd12ff71-4b04-462b-8485-fc7d5f3b9266 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019574 Jun 16 16:06:04.025792 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 25/50] 10.222.0.88 () {60 vars in 1210 bytes} [Thu Jun 16 16:06:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:06:04.036143 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-e64b56cf-8ae4-4dc1-a4ef-43b9166ef2b4 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:04.049901 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-e64b56cf-8ae4-4dc1-a4ef-43b9166ef2b4 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017354 Jun 16 16:06:04.050480 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 26/51] 10.222.0.88 () {60 vars in 1210 bytes} [Thu Jun 16 16:06:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:06:04.059993 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-3625ee34-bd21-49df-a35f-fb5decd4df29 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:04.065358 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.wsgi [None req-3625ee34-bd21-49df-a35f-fb5decd4df29 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-3625ee34-bd21-49df-a35f-fb5decd4df29 admin admin] Request method failure captured: Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Accept: application/json Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Accept-Encoding: gzip, deflate Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Connection: keep-alive Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Content-Length: 0 Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Host: 10.222.0.88 Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Openstack-Api-Version: compute 2.90 Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Openstack-System-Scope: None Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: User-Agent: python-novaclient Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Auth-Token: gAAAAABiq1TrerdTdYvqyxO3rXWrnlwGrn9TCaIbA3YQLkI-0neff1dwrAM5H0UsoAbAFLH6DdKHkPBONosWBVsdGLC7W24O2SOysYfMxIXPJHcrgR9xGsn1254K85R0BofNqkxkZuWnpdYgUJMLLwPOBZ1FfchV0U6rljnQhy9XZep255kfILs Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Domain-Id: None Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Domain-Name: None Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Identity-Status: Confirmed Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Is-Admin-Project: True Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Project-Domain-Id: default Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Project-Domain-Name: Default Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Project-Id: a913cabdc8c6449f971e776cd4ba8813 Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Project-Name: admin Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Role: reader,member,admin Jun 16 16:06:04.066892 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Roles: reader,member,admin Jun 16 16:06:04.068516 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a913cabdc8c6449f971e776cd4ba8813"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a913cabdc8c6449f971e776cd4ba8813"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a913cabdc8c6449f971e776cd4ba8813", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a913cabdc8c6449f971e776cd4ba8813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:06:04.068516 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Tenant: admin Jun 16 16:06:04.068516 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Tenant-Id: a913cabdc8c6449f971e776cd4ba8813 Jun 16 16:06:04.068516 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-Tenant-Name: admin Jun 16 16:06:04.068516 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-User: admin Jun 16 16:06:04.068516 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-User-Domain-Id: default Jun 16 16:06:04.068516 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-User-Domain-Name: Default Jun 16 16:06:04.068516 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-User-Id: fded449262ae4659b5d91d4b0bc2b7a0 Jun 16 16:06:04.068516 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: X-User-Name: admin Jun 16 16:06:04.068516 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: method: > Jun 16 16:06:04.068516 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: exception: Flavor 451 could not be found. Jun 16 16:06:04.068516 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: action_args: {'id': '451'} Jun 16 16:06:04.068516 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:06:04.068516 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:06:04.069563 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 16:06:04.069563 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 16:06:04.069563 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 16:06:04.069563 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 16:06:04.069563 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:06:04.069563 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:06:04.069563 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 16:06:04.069563 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 16:06:04.069563 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 16:06:04.069563 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:06:04.069563 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 16:06:04.069563 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 16:06:04.069563 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 16:06:04.069563 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 16 16:06:04.069563 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:06:04.069563 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 16 16:06:04.069563 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:06:04.069563 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:06:04.069563 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:06:04.070877 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:06:04.070877 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:06:04.070877 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:06:04.070877 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:06:04.070877 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 16:06:04.070877 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:06:04.070877 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 16:06:04.070877 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 16 16:06:04.070877 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:06:04.070877 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 16 16:06:04.070877 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:06:04.070877 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:06:04.070877 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:06:04.070877 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:06:04.070877 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:06:04.070877 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 16:06:04.070877 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 16 16:06:04.070877 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-3625ee34-bd21-49df-a35f-fb5decd4df29 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:06:04.072352 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-3625ee34-bd21-49df-a35f-fb5decd4df29 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012020 Jun 16 16:06:04.072352 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 26/52] 10.222.0.88 () {60 vars in 1193 bytes} [Thu Jun 16 16:06:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 16:06:04.937487 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-e64b56cf-8ae4-4dc1-a4ef-43b9166ef2b4 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:04.938520 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-e64b56cf-8ae4-4dc1-a4ef-43b9166ef2b4 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 16 16:06:04.938919 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 27/53] 10.222.0.88 () {56 vars in 1074 bytes} [Thu Jun 16 16:06:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:06:05.131439 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-d4bdf7ec-00fe-4267-82ff-a7087f64c098 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:06:05.150023 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-d4bdf7ec-00fe-4267-82ff-a7087f64c098 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070594 Jun 16 16:06:05.150512 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 27/54] 10.222.0.88 () {64 vars in 1235 bytes} [Thu Jun 16 16:06:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:06:06.019503 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-e64b56cf-8ae4-4dc1-a4ef-43b9166ef2b4 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:06.020516 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-e64b56cf-8ae4-4dc1-a4ef-43b9166ef2b4 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 16 16:06:06.020912 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 28/55] 10.222.0.88 () {56 vars in 1074 bytes} [Thu Jun 16 16:06:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:06:06.212207 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-1446f16b-886e-4f1c-9116-2230ee302935 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:06:06.230884 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-1446f16b-886e-4f1c-9116-2230ee302935 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.072008 Jun 16 16:06:06.231356 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 28/56] 10.222.0.88 () {64 vars in 1235 bytes} [Thu Jun 16 16:06:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:06:07.110900 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-e64b56cf-8ae4-4dc1-a4ef-43b9166ef2b4 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:07.111911 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-e64b56cf-8ae4-4dc1-a4ef-43b9166ef2b4 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 16 16:06:07.112314 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 29/57] 10.222.0.88 () {56 vars in 1074 bytes} [Thu Jun 16 16:06:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:06:07.304376 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-a6718304-2ddc-4fc2-89cd-6345a2484ab3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:06:07.322214 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-a6718304-2ddc-4fc2-89cd-6345a2484ab3 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070544 Jun 16 16:06:07.322704 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 29/58] 10.222.0.88 () {64 vars in 1235 bytes} [Thu Jun 16 16:06:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:06:08.193838 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-e64b56cf-8ae4-4dc1-a4ef-43b9166ef2b4 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:08.194860 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-e64b56cf-8ae4-4dc1-a4ef-43b9166ef2b4 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 16 16:06:08.195264 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 30/59] 10.222.0.88 () {56 vars in 1074 bytes} [Thu Jun 16 16:06:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:06:08.389280 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-6592c5a5-763d-4481-90ac-d27a2f3f3f03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:06:08.407260 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-6592c5a5-763d-4481-90ac-d27a2f3f3f03 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071333 Jun 16 16:06:08.407728 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 30/60] 10.222.0.88 () {64 vars in 1235 bytes} [Thu Jun 16 16:06:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:06:09.272860 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-e64b56cf-8ae4-4dc1-a4ef-43b9166ef2b4 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:09.273964 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-e64b56cf-8ae4-4dc1-a4ef-43b9166ef2b4 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 16 16:06:09.274373 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 31/61] 10.222.0.88 () {56 vars in 1074 bytes} [Thu Jun 16 16:06:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:06:09.463565 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-9a0f1620-5784-4e8f-b77f-0f42105d69dc admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:09.484236 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-9a0f1620-5784-4e8f-b77f-0f42105d69dc admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071552 Jun 16 16:06:09.484764 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 31/62] 10.222.0.88 () {60 vars in 1202 bytes} [Thu Jun 16 16:06:09 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:06:57.230253 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-e64b56cf-8ae4-4dc1-a4ef-43b9166ef2b4 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:57.230837 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-e64b56cf-8ae4-4dc1-a4ef-43b9166ef2b4 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jun 16 16:06:57.231245 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 32/63] 10.222.0.88 () {54 vars in 930 bytes} [Thu Jun 16 16:06:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:06:57.241686 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:57.293859 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-ca405c19-8ffe-4f5d-b962-222669e508d3 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:57.313551 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-ca405c19-8ffe-4f5d-b962-222669e508d3 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076303 Jun 16 16:06:57.317007 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 32/64] 10.222.0.88 () {60 vars in 1291 bytes} [Thu Jun 16 16:06:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:06:57.337220 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-5cce8855-0f72-4172-ac6d-6e31391bf52f admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:57.340798 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writing DB stats nova_api:SELECT=14 {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:57.346837 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-5cce8855-0f72-4172-ac6d-6e31391bf52f admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013324 Jun 16 16:06:57.347401 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 33/65] 10.222.0.88 () {60 vars in 1282 bytes} [Thu Jun 16 16:06:57 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:06:57.360127 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-02fa9b3b-cdb7-41be-a8e3-a56103ac46aa admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:57.368889 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-02fa9b3b-cdb7-41be-a8e3-a56103ac46aa admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011810 Jun 16 16:06:57.369439 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 33/66] 10.222.0.88 () {60 vars in 1285 bytes} [Thu Jun 16 16:06:57 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:06:57.381194 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-9833cbcf-8b0a-4a32-abc6-abed47ff47cf admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:57.389619 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-9833cbcf-8b0a-4a32-abc6-abed47ff47cf admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012076 Jun 16 16:06:57.390236 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 34/67] 10.222.0.88 () {60 vars in 1285 bytes} [Thu Jun 16 16:06:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:06:57.402253 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-52bdf573-28e3-4529-b855-8a669f97dcf8 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:06:57.410088 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-52bdf573-28e3-4529-b855-8a669f97dcf8 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011678 Jun 16 16:06:57.410698 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 34/68] 10.222.0.88 () {60 vars in 1282 bytes} [Thu Jun 16 16:06:57 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:10:20.637181 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-9833cbcf-8b0a-4a32-abc6-abed47ff47cf admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:10:20.638384 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-9833cbcf-8b0a-4a32-abc6-abed47ff47cf admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jun 16 16:10:20.638865 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 35/69] 10.222.0.88 () {56 vars in 1074 bytes} [Thu Jun 16 16:10:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:10:20.814584 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_api:SELECT=6 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:10:20.931220 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-18d104f2-11ac-4727-be52-6d717ede92ba admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:10:20.932474 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:10:20.932474 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: warnings.warn(msg) Jun 16 16:10:20.934076 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-18d104f2-11ac-4727-be52-6d717ede92ba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:10:20.934593 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-18d104f2-11ac-4727-be52-6d717ede92ba admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:10:20.935911 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-18d104f2-11ac-4727-be52-6d717ede92ba admin admin] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:10:20.936358 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-18d104f2-11ac-4727-be52-6d717ede92ba admin admin] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:10:20.977424 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-18d104f2-11ac-4727-be52-6d717ede92ba admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.164323 Jun 16 16:10:20.978020 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 35/70] 10.222.0.88 () {60 vars in 1193 bytes} [Thu Jun 16 16:10:20 2022] GET /compute/v2.1/os-services => generated 791 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:10:21.875433 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-9833cbcf-8b0a-4a32-abc6-abed47ff47cf admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:10:21.876471 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-9833cbcf-8b0a-4a32-abc6-abed47ff47cf admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002023 Jun 16 16:10:21.876867 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 36/71] 10.222.0.88 () {56 vars in 1074 bytes} [Thu Jun 16 16:10:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:10:22.073913 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-29824a84-44aa-4cfe-8479-685c2da88181 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:10:22.075118 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:10:22.075118 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: warnings.warn(msg) Jun 16 16:10:22.076297 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-29824a84-44aa-4cfe-8479-685c2da88181 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:10:22.076741 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-29824a84-44aa-4cfe-8479-685c2da88181 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:10:22.077810 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-29824a84-44aa-4cfe-8479-685c2da88181 admin admin] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:10:22.078117 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-29824a84-44aa-4cfe-8479-685c2da88181 admin admin] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:10:22.098323 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-29824a84-44aa-4cfe-8479-685c2da88181 admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080439 Jun 16 16:10:22.098807 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 36/72] 10.222.0.88 () {60 vars in 1193 bytes} [Thu Jun 16 16:10:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:10:33.447409 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-9833cbcf-8b0a-4a32-abc6-abed47ff47cf admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:10:33.448418 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-9833cbcf-8b0a-4a32-abc6-abed47ff47cf admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 16 16:10:33.448817 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 37/73] 10.222.0.88 () {56 vars in 1074 bytes} [Thu Jun 16 16:10:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:10:33.594388 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_cell0:SELECT=4 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:10:33.595105 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_cell1:SELECT=4 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:10:33.595711 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_api:SELECT=8 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:10:33.650274 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-4640fe4f-2c8f-4bde-871d-3f1230c0d6b0 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:10:33.651632 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:10:33.651632 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: warnings.warn(msg) Jun 16 16:10:33.652880 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-4640fe4f-2c8f-4bde-871d-3f1230c0d6b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:10:33.653347 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-4640fe4f-2c8f-4bde-871d-3f1230c0d6b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:10:33.654204 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-4640fe4f-2c8f-4bde-871d-3f1230c0d6b0 admin admin] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:10:33.654660 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-4640fe4f-2c8f-4bde-871d-3f1230c0d6b0 admin admin] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:10:33.679911 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-4640fe4f-2c8f-4bde-871d-3f1230c0d6b0 admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.090688 Jun 16 16:10:33.680475 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 37/74] 10.222.0.88 () {60 vars in 1193 bytes} [Thu Jun 16 16:10:33 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:10:34.558817 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-9833cbcf-8b0a-4a32-abc6-abed47ff47cf admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:10:34.560424 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-9833cbcf-8b0a-4a32-abc6-abed47ff47cf admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002426 Jun 16 16:10:34.560823 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 38/75] 10.222.0.88 () {56 vars in 1074 bytes} [Thu Jun 16 16:10:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:10:34.756635 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-99168eb6-5ace-4940-a2fd-56069b0f70c4 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:10:34.757928 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:10:34.757928 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: warnings.warn(msg) Jun 16 16:10:34.759178 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-99168eb6-5ace-4940-a2fd-56069b0f70c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:10:34.759782 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-99168eb6-5ace-4940-a2fd-56069b0f70c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:10:34.760477 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-99168eb6-5ace-4940-a2fd-56069b0f70c4 admin admin] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:10:34.760948 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-99168eb6-5ace-4940-a2fd-56069b0f70c4 admin admin] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:10:34.783559 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-99168eb6-5ace-4940-a2fd-56069b0f70c4 admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084089 Jun 16 16:10:34.784055 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 38/76] 10.222.0.88 () {60 vars in 1193 bytes} [Thu Jun 16 16:10:34 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:11:34.087616 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: Thu Jun 16 16:11:34 2022 - graceful shutdown triggered... Jun 16 16:11:34.087669 dv-cinder-837354-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 16:11:34.088541 dv-cinder-837354-2-iscsi devstack@n-api.service[103341]: Gracefully killing worker 1 (pid: 103341)... Jun 16 16:11:34.088901 dv-cinder-837354-2-iscsi devstack@n-api.service[103342]: Gracefully killing worker 2 (pid: 103342)... Jun 16 16:11:35.089521 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: worker 1 buried after 1 seconds Jun 16 16:11:35.089521 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: worker 2 buried after 1 seconds Jun 16 16:11:35.089521 dv-cinder-837354-2-iscsi devstack@n-api.service[103340]: goodbye to uWSGI. Jun 16 16:11:35.091101 dv-cinder-837354-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 16 16:11:35.091762 dv-cinder-837354-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 16:11:35.094865 dv-cinder-837354-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 16:11:35.103798 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 16:11:35.105795 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 16:11:35 2022] *** Jun 16 16:11:35.105795 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 16:11:35.105795 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 16:11:35.105795 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: nodename: dv-cinder-837354-2-iscsi Jun 16 16:11:35.105795 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: machine: x86_64 Jun 16 16:11:35.105795 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: clock source: unix Jun 16 16:11:35.105795 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: pcre jit disabled Jun 16 16:11:35.105795 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: detected number of CPU cores: 4 Jun 16 16:11:35.105795 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: current working directory: / Jun 16 16:11:35.105795 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: detected binary path: /usr/bin/uwsgi-core Jun 16 16:11:35.106589 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: your processes number limit is 47680 Jun 16 16:11:35.106589 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: your memory page size is 4096 bytes Jun 16 16:11:35.106589 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: detected max file descriptor number: 2048 Jun 16 16:11:35.106589 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: lock engine: pthread robust mutexes Jun 16 16:11:35.106589 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: thunder lock: enabled Jun 16 16:11:35.106589 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 16:11:35.106589 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 16:11:35.151009 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: Python main interpreter initialized at 0x5596f58739c0 Jun 16 16:11:35.151009 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: python threads support enabled Jun 16 16:11:35.151009 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: your server socket listen backlog is limited to 100 connections Jun 16 16:11:35.151009 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: your mercy for graceful operations on workers is 90 seconds Jun 16 16:11:35.151458 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 16:11:35.151458 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: *** Operational MODE: preforking *** Jun 16 16:11:35.151732 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: *** uWSGI is running in multiple interpreter mode *** Jun 16 16:11:35.151732 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: spawned uWSGI master process (pid: 117692) Jun 16 16:11:35.151941 dv-cinder-837354-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 16:11:35.156231 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: spawned uWSGI worker 1 (pid: 117711, cores: 1) Jun 16 16:11:35.156231 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: spawned uWSGI worker 2 (pid: 117712, cores: 1) Jun 16 16:11:35.156231 dv-cinder-837354-2-iscsi devstack@n-api.service[117692]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 16:11:35.824956 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 16:11:35.825539 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 16:11:37.091078 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:11:37.091078 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: from cryptography.utils import int_from_bytes Jun 16 16:11:37.092221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:11:37.092221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: from cryptography.utils import int_from_bytes Jun 16 16:11:37.092350 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:11:37.092350 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: from cryptography.utils import int_from_bytes Jun 16 16:11:37.092735 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:11:37.092735 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: from cryptography.utils import int_from_bytes Jun 16 16:11:39.525556 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 16:11:39.526129 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 16:11:39.526210 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 16:11:39.526564 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 16:11:39.526830 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 16:11:39.527226 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.527555 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.527882 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.528204 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.528538 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.528880 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.529207 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.529534 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.529893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.530158 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.530477 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.530804 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837354-2-iscsi {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.531130 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.531445 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.531766 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.532087 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.532401 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.532726 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.533033 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.533537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.534887 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.534887 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.534887 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.535181 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.535276 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.535561 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.535895 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.536202 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.536529 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.536972 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.537253 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837354-2-iscsi {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.537563 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.537917 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.538226 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.538643 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.538960 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.539271 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.539708 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.539923 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.540260 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.540582 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.540904 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.541225 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.541700 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.541700 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.542182 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.542494 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.542816 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.543124 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.543431 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.543683 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.543995 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.544829 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.545162 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.545489 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.545770 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.546029 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.546349 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.546676 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.546986 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.547298 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.547613 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.547922 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.548230 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.548537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.548847 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.549154 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.549476 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.549821 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.550149 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.550450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.550774 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.551175 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.551433 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.551746 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.552089 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.552413 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.552722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.553043 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.553365 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.553675 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.554013 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.554324 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.554645 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.554986 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.555296 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.555548 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.555855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.556162 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.556484 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.556797 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.557103 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.557413 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.557808 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.558051 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.558360 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.558672 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.558978 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.559290 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.559603 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.559913 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.560842 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.561155 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.561480 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.561834 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.562149 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.562448 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 16:11:39.562932 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.563088 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 16:11:39.563232 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.563232 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.563537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 16:11:39.563689 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.563838 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 16:11:39.565152 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.565323 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 16:11:39.565424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.565519 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.565612 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.565707 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.565873 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.565986 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.566104 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.566215 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.566324 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.566443 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.566566 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.566676 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.566794 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.566977 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.567134 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.567134 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.567413 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.567524 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.567623 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.567623 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.567821 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.567975 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.568093 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.568093 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.568305 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837354-2-iscsi {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.568390 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.568487 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.568573 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.568665 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.568749 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.568832 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.568937 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.569088 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.569189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.569274 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.569366 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.569486 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.569613 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.569812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.569917 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.570229 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.570344 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.570543 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.570646 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.570932 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.571062 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.571199 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.571290 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.571524 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.571635 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.571843 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.571944 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.572154 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.572252 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.572474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.572575 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.572783 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.572881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.573106 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.573203 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.573419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.573513 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.573792 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.573928 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837354-2-iscsi {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.574113 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.574277 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.574977 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.575120 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.575271 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.575393 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.575513 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.575660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.575779 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.575894 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.576029 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.576167 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.576306 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.576443 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.576573 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.576700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.576825 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.576977 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.577119 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.577246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.577643 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.577803 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.577944 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.578417 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.578774 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.579240 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.579532 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.580201 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.580486 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.580625 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.580753 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.580897 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.581030 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.581118 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.581118 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.581286 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.581370 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.581470 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.581555 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.581645 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.581783 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.581872 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.581967 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.582121 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.582214 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.582306 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.582397 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.582517 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.582618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.582703 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.582785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.582785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.582947 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.583037 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.583137 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.583222 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.583303 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.583391 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.583482 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.583578 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.583668 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.583759 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.583848 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.583940 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.584031 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.584360 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.584457 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.584549 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.584632 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.584725 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.584817 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.584915 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.584999 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.585143 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.585297 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.585461 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.585615 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.585787 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.585967 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.586107 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.586286 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.586544 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.586710 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.586839 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.586982 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.587152 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.587297 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.587500 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.587642 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.587809 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.587950 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.588115 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.588214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.588433 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.588543 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.588754 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.588856 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.589062 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.589156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.589368 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.589479 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.589673 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.589794 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.590021 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.590188 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.590345 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.590494 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.590641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.590821 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.590984 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.591122 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.591313 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.591453 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.591629 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.591788 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.591937 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.592085 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.592385 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.592745 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.593864 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.593959 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.593959 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.594091 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.594176 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.594256 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.594328 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.594663 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.594742 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.594833 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.594923 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.595015 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.595090 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.595160 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.595387 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.595514 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.595793 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.596023 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.596128 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.596341 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.596440 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.596676 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.596789 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.596980 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.597078 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.597303 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.597401 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.597636 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.597853 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.597941 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.598013 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.598244 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.598346 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.598539 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.598644 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.598917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.599018 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.599294 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.599391 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.599563 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.599664 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.599871 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.599974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.600265 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.600373 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.600496 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.600631 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.600847 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.600996 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.601160 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.601313 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.601453 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.601594 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.601811 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.601922 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.602010 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.602229 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.602344 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.602538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.602641 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.602856 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.602950 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.603214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.603369 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.603514 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.603708 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.603868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.604019 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.604119 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.604300 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.604537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.604891 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.605048 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.605048 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.605216 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.605360 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.605453 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.605699 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.605815 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.606025 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.606115 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.606348 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.606449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.606663 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.606754 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.607507 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.607642 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.607827 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.607922 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.608161 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.608266 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.608461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.608660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:11:39.608983 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.609076 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.609208 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.609387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.609516 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.609862 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.610022 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.610382 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.610647 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.610750 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.610836 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.610982 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.611080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.611311 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.611491 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.611652 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.611754 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.611939 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.612106 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.612288 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.612437 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.612626 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.612754 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.612948 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.613076 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.613275 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.613391 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.613593 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.613712 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.613942 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.614048 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.614262 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.614480 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.614644 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.614790 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.614961 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.615110 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.615278 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.615429 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.615603 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.615741 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.615918 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.616059 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.616240 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.616388 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.616556 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.616713 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.616883 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.617126 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.617237 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.617364 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.617508 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.617712 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.617892 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.618034 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.618151 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.618355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.618483 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.618682 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.618820 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.618982 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.619138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.619303 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.619511 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.619629 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.619772 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.619925 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.620088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.620257 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.620401 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.620611 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.620721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.620876 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.620999 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.621189 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.621310 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.621498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.621629 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.621832 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.621980 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.622144 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.622295 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.622484 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.622675 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.622856 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.622988 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.623263 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.623373 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.623500 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.623595 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.623812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.623911 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.624133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.624225 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.624447 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.624548 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.624809 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.624901 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.625281 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.625386 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.625596 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.625701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.625933 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.626027 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.626243 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.626349 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.626557 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.626648 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.626865 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.626958 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.627235 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.627352 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.627492 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.627583 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.627804 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.627896 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.628113 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.628214 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.628430 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.628520 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.628743 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.628834 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.629053 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.629155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.629362 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.629462 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.629668 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.629801 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.630016 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.630123 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.630326 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.630425 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.630636 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.630761 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.630950 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.631056 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.631259 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.631360 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.631565 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.631675 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.631888 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.631990 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.632192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.632304 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.632496 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.632598 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.632808 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.632908 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.633121 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.633222 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.633430 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.633541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.633752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.633856 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.634056 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.634149 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.634374 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.634485 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.634683 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.634787 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.634996 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.635200 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.635317 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.635421 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.635750 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.635882 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.636099 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.636234 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.637086 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.637204 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.637348 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.637434 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.637507 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.637578 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.637658 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.637764 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.637843 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.637927 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.638840 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.638953 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.639124 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.639203 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.639274 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.639374 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.639456 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.639856 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.640030 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.640176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.640318 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.640473 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.640648 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.640947 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.640947 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.641249 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.641398 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.641551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.641695 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.641866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.642010 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.642151 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.642304 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.642419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.642515 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.642608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.642870 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.643183 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.643313 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.643492 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.643619 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.643812 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.643987 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.644120 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.644260 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.644472 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.644689 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.644794 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.645038 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.645139 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.645347 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.645447 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.645655 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.645771 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.646030 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.646134 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.646341 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.646434 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.646659 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.646750 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.646978 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.647077 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.647295 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.647395 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.647610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.647710 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.647916 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.648020 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.648237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.648327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.648542 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.648640 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.648850 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.648990 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.649158 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.649253 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.649473 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.649572 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.649866 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.650020 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.650122 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.650207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.650419 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.650557 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.650731 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.650883 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.651077 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.651177 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.651360 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.651452 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.651676 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.651841 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.651990 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.652142 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.652296 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.652442 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.652599 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.652745 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.652885 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.653024 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.653165 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.653320 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.653469 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.653608 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.653874 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.654080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.654232 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.654388 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.654528 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.654667 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.654819 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.654965 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.655104 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.655258 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.655415 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.655561 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.655702 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.655840 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.655985 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.656141 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.656281 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.656427 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.656569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.656708 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.656847 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.656994 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.657134 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.657284 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.657455 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.657607 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.657782 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.657933 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.658082 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.658230 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.658379 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.658519 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.658671 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.658809 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.658971 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.659139 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.659301 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.659403 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.659560 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.659655 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.659888 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.660040 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.660180 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.660276 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.660495 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.660591 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.660800 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.660902 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.661171 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.661283 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.661485 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.661589 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.661831 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.662005 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.662159 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.662364 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.662528 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.662680 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.662836 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.662981 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.663122 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.663338 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.663501 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.663714 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.663874 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.664092 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.664283 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.664430 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.664688 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.664874 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.665129 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.665279 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.665435 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.665602 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.665871 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.666040 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.666197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.666556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.666895 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.667055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.667303 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.667435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.667644 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.667774 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.667995 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.668117 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.668348 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.668504 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.668694 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.668861 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.670130 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.670379 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.670535 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.670667 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.670896 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.671023 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.671240 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.671436 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.671596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.671831 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.671970 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.672217 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.672339 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.672587 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.672732 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.672915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.673045 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.673276 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.673403 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.673625 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.673806 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.673996 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.674158 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.674364 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.674532 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.674695 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.674870 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.675052 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.675307 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.675441 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.675638 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.675766 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.676051 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.676185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.676371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.676500 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.676734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.677053 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.677186 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.677417 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.677565 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.677777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.677917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.678104 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.678293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.678436 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.678682 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.678826 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.679054 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.679202 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.679453 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.679594 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.679787 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.679922 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.680324 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.680518 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.680655 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.680796 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.680928 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.681130 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.681289 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.681504 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.681629 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.681826 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.682065 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.682191 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.682366 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.682502 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.682725 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.682967 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.683097 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.683312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.683448 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.683635 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.683757 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.683951 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.684078 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.684482 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.684668 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.684816 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.684981 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.685145 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.685950 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.686099 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.686327 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.686465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.686722 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.686857 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.687047 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.687181 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.687422 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.687555 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.687765 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.687901 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.688097 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.688230 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.688450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.688646 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.688783 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.689048 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.689193 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.689576 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.689753 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.689900 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.690039 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.690159 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.690360 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.690502 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.690727 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.690872 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.691130 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.691882 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.691882 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.692252 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.692252 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.692510 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.692760 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.692995 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.693139 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.693270 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.693408 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.693538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.693667 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.693906 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.694054 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.694192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.694331 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.694476 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.694673 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.694804 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.694947 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.695077 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.695216 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.695353 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.695482 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.695619 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.695757 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.695895 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.696025 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.696153 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.696280 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.696416 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.696552 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.696689 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.696817 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.696944 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.697127 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.697270 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.697453 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.697593 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.697798 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.697932 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.698120 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.698272 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.698436 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.698569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.698748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.698879 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.699051 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.699194 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.699362 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.699501 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.699791 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.699934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.700079 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.700264 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.700423 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.700638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.700772 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.700903 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.701047 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.701187 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.701318 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.701451 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.701603 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.701826 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.701980 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.702121 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.702274 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.702487 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.702620 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.702749 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.702889 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.703042 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.703253 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.703394 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.703534 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.703674 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.703812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.703943 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.704072 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.704211 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.704349 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.704495 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.704649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.704845 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.704977 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.705116 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.705262 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.705402 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.705541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.705680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.705846 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.705985 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.706115 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.706259 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.706398 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.706529 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.706660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.706797 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.706937 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.707146 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.707279 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.707409 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.707548 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.707681 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.707819 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.707957 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.708093 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.708262 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.708406 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.708597 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.708746 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.708909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.709049 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.709215 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.709450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.709591 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.709897 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.710048 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.710182 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.710323 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.710463 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.710702 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.710909 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.711043 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.711182 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.711328 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.712876 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.713246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.713479 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.713479 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.714845 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.715174 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.715391 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.715631 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.715631 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.715999 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.716158 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.716364 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.716525 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.716750 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.716962 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.717140 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.717502 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.717691 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.717944 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.718149 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.718369 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.718529 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.718673 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.718867 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.719082 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.719302 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.719734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.720062 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.720197 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.720330 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.720518 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.720711 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.720879 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.721172 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.721378 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.721517 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.721692 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.721989 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.722137 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.722302 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.722524 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.722760 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.723180 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.723345 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.723506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.723713 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.724006 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.724224 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.724421 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.724557 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.724744 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.724953 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.725129 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.725405 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.725594 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.725748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.725934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.726166 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.726316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.726501 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.726711 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.726860 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.727036 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.727264 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.727415 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.727591 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.727824 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.728582 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.728582 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.728920 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.729055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.729194 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.729333 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.729498 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.729637 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.729838 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.729997 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.730279 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.730423 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.730562 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.730705 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.730826 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.730957 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.731088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.731281 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.731396 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.731534 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.731676 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.732319 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.732456 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.732586 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.732716 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.732862 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.733091 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.733310 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.733443 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.733574 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.733730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.733866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.734023 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.734241 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.734374 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.734505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.734650 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.734782 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.734914 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.735043 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.735174 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.735306 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.735532 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.735666 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.735797 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.735935 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.736067 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.736205 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.736343 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.736481 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.736620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.736751 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.736881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.736881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.737150 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.737281 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.737410 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.737547 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.737677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.737845 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.737986 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.738125 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.738256 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.738393 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.738624 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.739180 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.739321 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.739454 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.739584 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.739723 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.739868 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.740000 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.740132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.740464 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.740595 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.740715 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.740840 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.740960 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.741070 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.741070 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.741314 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.741520 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.741668 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.741830 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.741970 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.742106 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.742273 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.742410 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.742523 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.742652 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.742896 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.743018 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.743228 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.743461 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.743582 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.743711 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.743823 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.743933 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.744051 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.744171 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.744390 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.744390 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.744604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.744724 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.744835 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.744835 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.745063 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.745063 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.745277 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.745396 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.745539 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.745539 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.745885 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.746021 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.746160 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.746290 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.746430 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.746562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.746562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.746807 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.746944 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.747082 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.747223 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.747354 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.747541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.747686 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.747686 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.747948 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.748102 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.748233 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.748362 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.748492 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.748636 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.748776 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.748915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.749046 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.749183 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.749321 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.749452 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.749598 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.749753 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.749870 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.749994 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.750111 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.750221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.750359 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.750770 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.750900 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.751027 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.751147 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.751267 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.751399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.751543 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.751751 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.751869 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.751993 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.752114 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.752226 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.752336 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.752445 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.752562 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.752562 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.752798 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.752922 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.753034 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.753143 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.753343 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.753486 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.753486 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.753486 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.754006 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.754138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.754275 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.754436 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.754651 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.754784 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.754915 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.755053 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.755194 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.755333 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.755333 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.755587 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.755733 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.755938 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.756072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.756194 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.756305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.756415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.756524 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.756651 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.756772 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.756892 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.757021 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.757221 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.757348 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.757460 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.757570 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.757689 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.757825 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.757938 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.758047 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.758155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.758529 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.758674 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.758758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.758915 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.759080 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.759275 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.759416 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.759416 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.759588 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.759670 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.759670 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.759812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.759893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.759893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.760031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.760104 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.760181 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.760264 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.760399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.760485 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.760585 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.760850 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.760942 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.761034 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.761034 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.761185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.761272 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.761364 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.761497 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.761603 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.761699 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.761937 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.762023 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.762110 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.762209 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.762307 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.762402 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.762402 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.762657 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.762747 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.762840 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.762928 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.762928 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.764883 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.764996 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.765083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.765253 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.765253 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.765424 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.765509 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.765593 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.765686 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.765807 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.766120 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.766227 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.766523 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.766631 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.766720 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.766815 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.766910 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.766910 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.767170 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.767265 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.767365 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.767460 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.767547 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.767631 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.767716 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.767801 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.767993 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.768173 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.768273 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.768368 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.768568 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.768676 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.768879 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.769019 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.769230 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.769328 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.769528 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.769636 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.769859 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.769968 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.770175 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.770302 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.770508 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.770603 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.770918 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.771023 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.771272 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.771369 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.771504 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.771598 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.771815 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.771916 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.772158 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.772254 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.772437 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.772550 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.772754 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.772909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.773075 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.773225 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.773389 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.773521 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.773696 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.773862 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.774061 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.774163 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.774353 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.774474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.774662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.774935 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.775031 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.775117 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.775260 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.775377 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.775567 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.775690 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.775878 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.776070 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.776186 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.776335 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.776500 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.776622 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.776784 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.776919 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.777092 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.777244 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.777398 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.777574 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.777706 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.777998 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.778073 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.778221 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.778335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.778534 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.778690 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.778926 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.779011 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.779290 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.779455 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.779597 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.779771 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.779931 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.780103 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.780265 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.780429 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.780583 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.780752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.780966 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.781062 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.781215 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.781391 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.781530 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.781735 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.781983 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.782058 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.782278 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.782373 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.782517 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.782602 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.782839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.782923 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.783153 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.783234 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.783490 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.783573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.783804 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.783885 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.784108 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.784207 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.784456 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.784570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.784727 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.784814 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.785097 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.785285 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.785385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.785634 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.785819 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.785973 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.786065 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.786301 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.786409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.786662 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.786800 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.786929 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.787012 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.787235 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.787319 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.787556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.787658 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.787861 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.787953 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.788164 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.788254 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.788476 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.788558 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.788860 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.788966 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.789261 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.789352 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.789436 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.789518 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.789748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.789916 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.790015 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.790099 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.790271 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.790377 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.790581 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.790673 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.790884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.790974 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.791211 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.791320 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.791574 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.791669 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.791809 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.791901 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.792110 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.792410 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.792523 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.792608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.792706 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.792899 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.793008 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.793211 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.793372 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.793530 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.793621 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.793870 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.793996 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.794180 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.794265 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.794960 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 16:11:39.795047 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.795348 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.795640 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.795941 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.796249 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.796700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.796921 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.797225 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.797527 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.798009 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.798187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.798507 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.798816 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.799124 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.799473 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.799789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.800353 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.800684 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.801001 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.801337 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.801703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.802217 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.802293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.802571 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.802928 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.803199 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.803508 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.803823 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.804214 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.804616 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.804732 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.805040 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.805549 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.805650 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.806332 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.806332 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.806745 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.806967 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.807136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.807475 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.807792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.808106 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.808422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.808739 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.809048 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.809359 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.809668 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.810078 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.810400 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.810732 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.811046 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.811389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.811810 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.812075 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.812393 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.812714 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.813020 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.813340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.813660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.814000 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.814319 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.814628 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.814952 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.815289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.815772 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.815930 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.816224 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.816526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.816831 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.817139 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.817453 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.817894 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.818068 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.818368 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.818679 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.818980 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.819282 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.819584 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.819886 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.820190 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.820489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.820789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.821115 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.821383 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.821675 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.822650 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.822650 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.822650 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.823283 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.823283 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.823601 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.823739 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.824046 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.824375 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.824687 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.825008 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.825317 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.826341 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.826573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.826949 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.827322 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.827535 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.827802 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.828135 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.828445 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.828754 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.829062 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.829369 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.829676 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.830148 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.830484 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.830811 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.831119 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.831446 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.831828 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.832256 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.832585 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.832818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.833225 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.833452 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.833668 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.833919 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.834207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.834517 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.834827 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.835143 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.835469 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.835791 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.836101 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.836594 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.836815 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.837135 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.837454 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.837708 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.838055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.838368 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.838679 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.838980 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:11:39.839210 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 16:11:39.866797 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO dbcounter [None req-7956d595-0ec2-4536-9e1a-b05d33b59ae1 None None] Registered counter for database nova_api Jun 16 16:11:39.887324 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_db.sqlalchemy.engines [None req-7956d595-0ec2-4536-9e1a-b05d33b59ae1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:11:39.894932 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writer thread running {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:11:39.904617 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO dbcounter [None req-56de96ba-5f09-40c8-a585-0ab66c5d9f9e None None] Registered counter for database nova_api Jun 16 16:11:39.924502 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_db.sqlalchemy.engines [None req-56de96ba-5f09-40c8-a585-0ab66c5d9f9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:11:39.931043 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writer thread running {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:11:39.954641 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.context [None req-7956d595-0ec2-4536-9e1a-b05d33b59ae1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf72e9e5-e7ed-4e44-b62a-c0132a022092(cell1) {{(pid=117711) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 16:11:39.958830 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7956d595-0ec2-4536-9e1a-b05d33b59ae1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:11:39.960407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7956d595-0ec2-4536-9e1a-b05d33b59ae1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:11:39.961217 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7956d595-0ec2-4536-9e1a-b05d33b59ae1 None None] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:11:39.963190 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7956d595-0ec2-4536-9e1a-b05d33b59ae1 None None] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:11:39.965182 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO dbcounter [None req-7956d595-0ec2-4536-9e1a-b05d33b59ae1 None None] Registered counter for database nova_cell0 Jun 16 16:11:39.969092 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO dbcounter [None req-7956d595-0ec2-4536-9e1a-b05d33b59ae1 None None] Registered counter for database nova_cell1 Jun 16 16:11:39.976871 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_db.sqlalchemy.engines [None req-7956d595-0ec2-4536-9e1a-b05d33b59ae1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:11:39.978389 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_db.sqlalchemy.engines [None req-7956d595-0ec2-4536-9e1a-b05d33b59ae1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:11:39.984827 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writer thread running {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:11:39.987078 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writer thread running {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:11:39.990402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.context [None req-56de96ba-5f09-40c8-a585-0ab66c5d9f9e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf72e9e5-e7ed-4e44-b62a-c0132a022092(cell1) {{(pid=117712) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 16:11:39.994649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-56de96ba-5f09-40c8-a585-0ab66c5d9f9e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:11:39.996151 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-56de96ba-5f09-40c8-a585-0ab66c5d9f9e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:11:39.996962 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-56de96ba-5f09-40c8-a585-0ab66c5d9f9e None None] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:11:39.999456 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-56de96ba-5f09-40c8-a585-0ab66c5d9f9e None None] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:11:40.001434 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO dbcounter [None req-56de96ba-5f09-40c8-a585-0ab66c5d9f9e None None] Registered counter for database nova_cell0 Jun 16 16:11:40.005357 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO dbcounter [None req-56de96ba-5f09-40c8-a585-0ab66c5d9f9e None None] Registered counter for database nova_cell1 Jun 16 16:11:40.012925 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_db.sqlalchemy.engines [None req-56de96ba-5f09-40c8-a585-0ab66c5d9f9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:11:40.015270 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_db.sqlalchemy.engines [None req-56de96ba-5f09-40c8-a585-0ab66c5d9f9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:11:40.021144 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writer thread running {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:11:40.022753 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writer thread running {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:11:40.133422 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO dbcounter [None req-7956d595-0ec2-4536-9e1a-b05d33b59ae1 None None] Registered counter for database nova_cell0 Jun 16 16:11:40.140444 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_db.sqlalchemy.engines [None req-7956d595-0ec2-4536-9e1a-b05d33b59ae1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:11:40.145063 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writer thread running {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:11:40.169609 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO dbcounter [None req-56de96ba-5f09-40c8-a585-0ab66c5d9f9e None None] Registered counter for database nova_cell0 Jun 16 16:11:40.176187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_db.sqlalchemy.engines [None req-56de96ba-5f09-40c8-a585-0ab66c5d9f9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:11:40.180560 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writer thread running {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:11:40.462938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: WARNING keystonemiddleware.auth_token [None req-7956d595-0ec2-4536-9e1a-b05d33b59ae1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:11:40.471007 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: WARNING keystonemiddleware.auth_token [None req-7956d595-0ec2-4536-9e1a-b05d33b59ae1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:11:40.499935 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: WARNING keystonemiddleware.auth_token [None req-56de96ba-5f09-40c8-a585-0ab66c5d9f9e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:11:40.507184 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: WARNING keystonemiddleware.auth_token [None req-56de96ba-5f09-40c8-a585-0ab66c5d9f9e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:11:40.816543 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: WARNING keystonemiddleware.auth_token [None req-7956d595-0ec2-4536-9e1a-b05d33b59ae1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:11:40.822530 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: WARNING keystonemiddleware.auth_token [None req-7956d595-0ec2-4536-9e1a-b05d33b59ae1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:11:40.828411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5596f58739c0 pid: 117711 (default app) Jun 16 16:11:40.861209 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: WARNING keystonemiddleware.auth_token [None req-56de96ba-5f09-40c8-a585-0ab66c5d9f9e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:11:40.867153 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: WARNING keystonemiddleware.auth_token [None req-56de96ba-5f09-40c8-a585-0ab66c5d9f9e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:11:40.872731 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5596f58739c0 pid: 117712 (default app) Jun 16 16:12:22.552348 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=3 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:22.553310 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=3 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:22.554162 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=3 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:22.558289 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=3 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:23.896563 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-14adac4c-88e1-4f3f-b34a-c70528369e72 tempest-VolumesGetTestJSON-1917862284 tempest-VolumesGetTestJSON-1917862284-project] Action: 'create', calling method: .version_select at 0x7f6f0f08c790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1907428904", "metadata": {"Type": "work"}}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:25.262090 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-14adac4c-88e1-4f3f-b34a-c70528369e72 tempest-VolumesGetTestJSON-1917862284 tempest-VolumesGetTestJSON-1917862284-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.720979 Jun 16 16:12:25.263637 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 1/1] 10.222.0.88 () {60 vars in 1155 bytes} [Thu Jun 16 16:12:22 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2725 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 16:12:25.861823 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b038a291-ed63-4d9f-930f-70b6e2688d89 tempest-VolumesGetTestJSON-1917862284 tempest-VolumesGetTestJSON-1917862284-project] Calling method '.version_select at 0x7f6f0fa949d0>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:25.925332 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:25.928597 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:25.929773 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:25.932540 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:27.358109 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b038a291-ed63-4d9f-930f-70b6e2688d89 tempest-VolumesGetTestJSON-1917862284 tempest-VolumesGetTestJSON-1917862284-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/0d48459e-9306-4723-a81d-38a0ed1d3754" status: 200 len: 354 microversion: 2.1 time: 2.084729 Jun 16 16:12:27.359283 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 1/2] 10.222.0.88 () {58 vars in 1244 bytes} [Thu Jun 16 16:12:25 2022] GET /compute/v2.1/os-volumes/0d48459e-9306-4723-a81d-38a0ed1d3754 => generated 354 bytes in 2088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:12:27.370668 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ca40e2e6-f535-48dc-b153-f180b2df01b0 tempest-VolumesGetTestJSON-1917862284 tempest-VolumesGetTestJSON-1917862284-project] Calling method '.version_select at 0x7f6f0ef545e0>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:27.516188 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ca40e2e6-f535-48dc-b153-f180b2df01b0 tempest-VolumesGetTestJSON-1917862284 tempest-VolumesGetTestJSON-1917862284-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/0d48459e-9306-4723-a81d-38a0ed1d3754" status: 200 len: 354 microversion: 2.1 time: 0.149695 Jun 16 16:12:27.517065 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 2/3] 10.222.0.88 () {58 vars in 1244 bytes} [Thu Jun 16 16:12:27 2022] GET /compute/v2.1/os-volumes/0d48459e-9306-4723-a81d-38a0ed1d3754 => generated 354 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:12:27.534020 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3d378bf2-5192-4f0d-9cd0-375298e3115b tempest-VolumesGetTestJSON-1917862284 tempest-VolumesGetTestJSON-1917862284-project] Calling method '.version_select at 0x7f6f0ef99670>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:27.830665 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3d378bf2-5192-4f0d-9cd0-375298e3115b tempest-VolumesGetTestJSON-1917862284 tempest-VolumesGetTestJSON-1917862284-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/0d48459e-9306-4723-a81d-38a0ed1d3754" status: 202 len: 0 microversion: 2.1 time: 0.301113 Jun 16 16:12:27.831574 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 2/4] 10.222.0.88 () {58 vars in 1247 bytes} [Thu Jun 16 16:12:27 2022] DELETE /compute/v2.1/os-volumes/0d48459e-9306-4723-a81d-38a0ed1d3754 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:12:27.839261 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f0465815-3811-466c-ac55-c253b04a8ef1 tempest-VolumesGetTestJSON-1917862284 tempest-VolumesGetTestJSON-1917862284-project] Calling method '.version_select at 0x7f6f0ef54700>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:27.975064 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f0465815-3811-466c-ac55-c253b04a8ef1 tempest-VolumesGetTestJSON-1917862284 tempest-VolumesGetTestJSON-1917862284-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/0d48459e-9306-4723-a81d-38a0ed1d3754" status: 200 len: 353 microversion: 2.1 time: 0.139561 Jun 16 16:12:27.976221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 3/5] 10.222.0.88 () {58 vars in 1244 bytes} [Thu Jun 16 16:12:27 2022] GET /compute/v2.1/os-volumes/0d48459e-9306-4723-a81d-38a0ed1d3754 => generated 353 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:12:28.987905 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-975bddf9-1be0-4b60-b354-01141d8efbd2 tempest-VolumesGetTestJSON-1917862284 tempest-VolumesGetTestJSON-1917862284-project] Calling method '.version_select at 0x7f6f0ef99820>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:29.043208 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-975bddf9-1be0-4b60-b354-01141d8efbd2 tempest-VolumesGetTestJSON-1917862284 tempest-VolumesGetTestJSON-1917862284-project] HTTP exception thrown: Volume 0d48459e-9306-4723-a81d-38a0ed1d3754 could not be found. Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-975bddf9-1be0-4b60-b354-01141d8efbd2 tempest-VolumesGetTestJSON-1917862284 tempest-VolumesGetTestJSON-1917862284-project] Request method failure captured: Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/os-volumes/0d48459e-9306-4723-a81d-38a0ed1d3754 HTTP/1.1 Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1ZmDRgmPzdXNtKba0Ci5Oh7U-NZIIqSRuJTmTJaE6n4WMpkBzr1tj9lIfp4-TXzTYIjhjl7labv3o20zRy5Foo8EnlFYiv3JZwRN61yFxhDAzZcs-m3hO8cIU-7WN5es8DAH6HimupP3-W4qjkktlTH9H2JAMyf6U4VkCwQ9pznU3Q Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: 391132d6e00c4f04b438e886be220105 Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesGetTestJSON-1917862284 Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:12:29.048909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:12:29.051185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/391132d6e00c4f04b438e886be220105"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/391132d6e00c4f04b438e886be220105"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_391132d6e00c4f04b438e886be220105", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/391132d6e00c4f04b438e886be220105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:12:29.051185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesGetTestJSON-1917862284 Jun 16 16:12:29.051185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 391132d6e00c4f04b438e886be220105 Jun 16 16:12:29.051185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesGetTestJSON-1917862284 Jun 16 16:12:29.051185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesGetTestJSON-1917862284-project Jun 16 16:12:29.051185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:12:29.051185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:12:29.051185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: 7ec9fb97bb154c41b6f0f2bfe1b9e7e9 Jun 16 16:12:29.051185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesGetTestJSON-1917862284-project Jun 16 16:12:29.051185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: Jun 16 16:12:29.051185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Volume 0d48459e-9306-4723-a81d-38a0ed1d3754 could not be found. Jun 16 16:12:29.051185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': '0d48459e-9306-4723-a81d-38a0ed1d3754'} Jun 16 16:12:29.051185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:12:29.052562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:12:29.052562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:12:29.052562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:12:29.052562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:12:29.052562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:12:29.052562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:12:29.052562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:12:29.052562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:12:29.052562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:12:29.052562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:12:29.052562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:12:29.052562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:12:29.052562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:12:29.052562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:12:29.052562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:12:29.052562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d48459e-9306-4723-a81d-38a0ed1d3754 could not be found. (HTTP 404) (Request-ID: req-ee69b39d-d510-4314-a7b3-8b4169b838fe) Jun 16 16:12:29.052562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:12:29.052562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:12:29.052562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:12:29.054408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:12:29.054408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 16:12:29.054408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 16:12:29.054408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:12:29.054408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:12:29.054408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:12:29.054408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:12:29.054408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:12:29.054408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:12:29.054408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:12:29.054408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:12:29.054408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:12:29.054408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:12:29.054408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:12:29.054408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:12:29.054408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:12:29.054408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:12:29.054408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:12:29.054408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:12:29.056098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:12:29.056098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:12:29.056098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:12:29.056098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:12:29.056098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d48459e-9306-4723-a81d-38a0ed1d3754 could not be found. Jun 16 16:12:29.056098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:12:29.056098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:12:29.056098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:12:29.056098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:12:29.056098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:12:29.056098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:12:29.056098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:12:29.056098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:12:29.056098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:12:29.056098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:12:29.056098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:12:29.056098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:12:29.056098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 16:12:29.056098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:12:29.058103 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d48459e-9306-4723-a81d-38a0ed1d3754 could not be found. Jun 16 16:12:29.058103 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:12:29.058103 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:12:29.058103 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:12:29.058103 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:12:29.058103 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:12:29.058103 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:12:29.058103 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:12:29.058103 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:12:29.058103 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d48459e-9306-4723-a81d-38a0ed1d3754 could not be found. Jun 16 16:12:29.058103 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:12:29.058103 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-975bddf9-1be0-4b60-b354-01141d8efbd2 tempest-VolumesGetTestJSON-1917862284 tempest-VolumesGetTestJSON-1917862284-project] Returning 404 to user: Volume 0d48459e-9306-4723-a81d-38a0ed1d3754 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:12:29.062252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-975bddf9-1be0-4b60-b354-01141d8efbd2 tempest-VolumesGetTestJSON-1917862284 tempest-VolumesGetTestJSON-1917862284-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/0d48459e-9306-4723-a81d-38a0ed1d3754" status: 404 len: 109 microversion: 2.1 time: 0.077343 Jun 16 16:12:29.065362 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 3/6] 10.222.0.88 () {58 vars in 1244 bytes} [Thu Jun 16 16:12:28 2022] GET /compute/v2.1/os-volumes/0d48459e-9306-4723-a81d-38a0ed1d3754 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:12:38.625035 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-832fd489-9c91-4314-a962-7d164e8a4273 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Action: 'create', calling method: .version_select at 0x7f6f0ef54ca0>, body: {"keypair": {"name": "tempest-keypair-979117578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhxNK/VLsEvFl7g/GV8YtjnkOU96/h3EuicDxvSAOBmqPP7+Pp5YzutYEpNm0UuF2xIsKc8eJaj9H1TGHA0ej5EwLVBsPjY+Nj8UUfdCo0a/+Dglxf8QXZ1c5/vlwnjfQ=="}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:38.800493 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-832fd489-9c91-4314-a962-7d164e8a4273 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Getting quotas for project dbfb390720a54a4eb35c80b0d1a1f16b. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:12:38.831791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-832fd489-9c91-4314-a962-7d164e8a4273 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Getting quotas for user 46445560ea7e496fa6c9c2e7c9a5b747 and project dbfb390720a54a4eb35c80b0d1a1f16b. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:12:38.985462 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-832fd489-9c91-4314-a962-7d164e8a4273 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.871656 Jun 16 16:12:38.986176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 4/7] 10.222.0.88 () {62 vars in 1199 bytes} [Thu Jun 16 16:12:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 873 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 16:12:40.115897 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-47e30a5c-31aa-4054-a0d1-92d0cad463b6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1877179033", "imageRef": "d2716dc1-3d4d-4f62-b0af-c38986f2a3aa", "flavorRef": "452", "networks": [{"uuid": "5d375348-adcc-438c-9fee-9cf43aa78b15"}]}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:40.348207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-47e30a5c-31aa-4054-a0d1-92d0cad463b6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] validate_networks() for [('5d375348-adcc-438c-9fee-9cf43aa78b15', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:12:41.901483 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fa08f1c9-02b3-4b9b-a37a-91d3aac27fbd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1394036384", "imageRef": "d2716dc1-3d4d-4f62-b0af-c38986f2a3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:42.079022 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.network.neutron [None req-fa08f1c9-02b3-4b9b-a37a-91d3aac27fbd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] validate_networks() for [('95eb63ba-1800-47ca-921c-a33b3a51a7cb', None, None, None, None, None)] {{(pid=117711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:12:43.684985 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-47e30a5c-31aa-4054-a0d1-92d0cad463b6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:12:43.686459 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-47e30a5c-31aa-4054-a0d1-92d0cad463b6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:12:43.687024 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-47e30a5c-31aa-4054-a0d1-92d0cad463b6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:12:43.687353 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-47e30a5c-31aa-4054-a0d1-92d0cad463b6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:12:43.687798 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-47e30a5c-31aa-4054-a0d1-92d0cad463b6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:12:43.726831 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-47e30a5c-31aa-4054-a0d1-92d0cad463b6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:43.727662 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-47e30a5c-31aa-4054-a0d1-92d0cad463b6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:43.731262 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-47e30a5c-31aa-4054-a0d1-92d0cad463b6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:43.731899 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-47e30a5c-31aa-4054-a0d1-92d0cad463b6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:43.818702 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-47e30a5c-31aa-4054-a0d1-92d0cad463b6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Getting quotas for project 24fb126babee4bbea59923603503a21a. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:12:43.841339 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-47e30a5c-31aa-4054-a0d1-92d0cad463b6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Getting quotas for user 5e2021bba1874f0fb4e6904aac576431 and project 24fb126babee4bbea59923603503a21a. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:12:43.868605 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-47e30a5c-31aa-4054-a0d1-92d0cad463b6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:12:43.879519 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-47e30a5c-31aa-4054-a0d1-92d0cad463b6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2716dc1-3d4d-4f62-b0af-c38986f2a3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:12:44.064688 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-47e30a5c-31aa-4054-a0d1-92d0cad463b6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.107677 Jun 16 16:12:44.065344 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 4/8] 10.222.0.88 () {60 vars in 1146 bytes} [Thu Jun 16 16:12:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 4109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:12:44.088024 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-979be4ea-ade3-4672-a644-5dc2b6e6f4f1 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:44.088730 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-979be4ea-ade3-4672-a644-5dc2b6e6f4f1 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:44.495764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-979be4ea-ade3-4672-a644-5dc2b6e6f4f1 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:44.525359 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-979be4ea-ade3-4672-a644-5dc2b6e6f4f1 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1215 microversion: 2.1 time: 0.446768 Jun 16 16:12:44.525985 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 5/9] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:44 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1215 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:44.981764 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-fa08f1c9-02b3-4b9b-a37a-91d3aac27fbd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Flavor limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:12:44.983064 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-fa08f1c9-02b3-4b9b-a37a-91d3aac27fbd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Image limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:12:44.984295 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-fa08f1c9-02b3-4b9b-a37a-91d3aac27fbd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Flavor pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:12:44.984922 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-fa08f1c9-02b3-4b9b-a37a-91d3aac27fbd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Image pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:12:44.985627 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-fa08f1c9-02b3-4b9b-a37a-91d3aac27fbd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:12:45.007330 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fa08f1c9-02b3-4b9b-a37a-91d3aac27fbd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:45.010306 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fa08f1c9-02b3-4b9b-a37a-91d3aac27fbd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:45.011406 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fa08f1c9-02b3-4b9b-a37a-91d3aac27fbd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:45.012068 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fa08f1c9-02b3-4b9b-a37a-91d3aac27fbd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:45.075561 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-fa08f1c9-02b3-4b9b-a37a-91d3aac27fbd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Getting quotas for project c3592ee016d1486db983b4ff2aab5ca3. Resources: {'ram', 'instances', 'cores'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:12:45.083231 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-fa08f1c9-02b3-4b9b-a37a-91d3aac27fbd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Getting quotas for user 16b8389777744e6581ad14be85731f4a and project c3592ee016d1486db983b4ff2aab5ca3. Resources: {'ram', 'instances', 'cores'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:12:45.155128 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fa08f1c9-02b3-4b9b-a37a-91d3aac27fbd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Going to run 1 instances... {{(pid=117711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:12:45.161666 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fa08f1c9-02b3-4b9b-a37a-91d3aac27fbd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2716dc1-3d4d-4f62-b0af-c38986f2a3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:12:45.395104 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fa08f1c9-02b3-4b9b-a37a-91d3aac27fbd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.731053 Jun 16 16:12:45.396615 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 5/10] 10.222.0.88 () {60 vars in 1146 bytes} [Thu Jun 16 16:12:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 3733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 16:12:45.417829 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-085f0497-4d69-49e1-b304-896347311519 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:45.420052 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-085f0497-4d69-49e1-b304-896347311519 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:45.601903 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-085f0497-4d69-49e1-b304-896347311519 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:45.661415 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-085f0497-4d69-49e1-b304-896347311519 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1222 microversion: 2.1 time: 0.238545 Jun 16 16:12:45.674121 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 6/11] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:45 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1222 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:45.683269 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-92001a28-b866-49a0-92d7-b5a34e993ba3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:45.687081 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-92001a28-b866-49a0-92d7-b5a34e993ba3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:45.825979 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2d1fc6e4-7867-4367-b7b9-cf3458311436 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Action: 'create', calling method: .version_select at 0x7f6f0e5d5430>, body: {"keypair": {"name": "tempest-keypair-1170520403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiDHAPubGYjeAS1Nq3MeQZ2PxQicgLyB7t5Dsq0Io8Y3xE16nKCgHSvDCdpQTc29w4Qna6GRnjUooYLDk+bGGkphsxX1RJ60Q0zL2NOX1BMIzXGnYa6bk8rnd9gUSS2xQ=="}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:45.842162 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-92001a28-b866-49a0-92d7-b5a34e993ba3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:45.853274 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-92001a28-b866-49a0-92d7-b5a34e993ba3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1215 microversion: 2.1 time: 0.184906 Jun 16 16:12:45.854307 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 7/12] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:45 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1215 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:45.936134 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-2d1fc6e4-7867-4367-b7b9-cf3458311436 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Getting quotas for project c1cdf363c2e44af5b0d8cd748c58235b. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:12:45.943580 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-2d1fc6e4-7867-4367-b7b9-cf3458311436 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Getting quotas for user bfbcc9b45bc341228bcc0f2192040224 and project c1cdf363c2e44af5b0d8cd748c58235b. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:12:46.075414 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2d1fc6e4-7867-4367-b7b9-cf3458311436 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.920768 Jun 16 16:12:46.084172 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 6/13] 10.222.0.88 () {60 vars in 1158 bytes} [Thu Jun 16 16:12:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:12:46.165160 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9adaeb85-399a-4a63-ae64-efc3e0a9a47e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-202551163", "imageRef": "d2716dc1-3d4d-4f62-b0af-c38986f2a3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25722f8f-379b-492d-af6a-68efbda1c91b"}], "security_groups": [{"name": "tempest-securitygroup--1022640843"}], "key_name": "tempest-keypair-979117578", "user_data": "}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:46.532795 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.network.neutron [None req-9adaeb85-399a-4a63-ae64-efc3e0a9a47e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] validate_networks() for [('25722f8f-379b-492d-af6a-68efbda1c91b', None, None, None, None, None)] {{(pid=117711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:12:46.857817 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-af9c27f4-527b-432c-8605-b2fae7ca286f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1708924431", "imageRef": "d2716dc1-3d4d-4f62-b0af-c38986f2a3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:46.983263 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-af9c27f4-527b-432c-8605-b2fae7ca286f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] validate_networks() for [('95eb63ba-1800-47ca-921c-a33b3a51a7cb', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:12:48.026004 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-9adaeb85-399a-4a63-ae64-efc3e0a9a47e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Flavor limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:12:48.028108 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-9adaeb85-399a-4a63-ae64-efc3e0a9a47e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Image limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:12:48.028737 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-9adaeb85-399a-4a63-ae64-efc3e0a9a47e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Flavor pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:12:48.029281 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-9adaeb85-399a-4a63-ae64-efc3e0a9a47e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Image pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:12:48.037946 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-9adaeb85-399a-4a63-ae64-efc3e0a9a47e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:12:48.062648 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9adaeb85-399a-4a63-ae64-efc3e0a9a47e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:48.064024 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9adaeb85-399a-4a63-ae64-efc3e0a9a47e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:48.067406 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9adaeb85-399a-4a63-ae64-efc3e0a9a47e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:48.069232 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9adaeb85-399a-4a63-ae64-efc3e0a9a47e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:48.137967 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-9adaeb85-399a-4a63-ae64-efc3e0a9a47e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Getting quotas for project dbfb390720a54a4eb35c80b0d1a1f16b. Resources: {'ram', 'instances', 'cores'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:12:48.151478 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-9adaeb85-399a-4a63-ae64-efc3e0a9a47e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Getting quotas for user 46445560ea7e496fa6c9c2e7c9a5b747 and project dbfb390720a54a4eb35c80b0d1a1f16b. Resources: {'ram', 'instances', 'cores'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:12:48.204035 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9adaeb85-399a-4a63-ae64-efc3e0a9a47e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Going to run 1 instances... {{(pid=117711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:12:48.210596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9adaeb85-399a-4a63-ae64-efc3e0a9a47e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2716dc1-3d4d-4f62-b0af-c38986f2a3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:12:48.393652 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9adaeb85-399a-4a63-ae64-efc3e0a9a47e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.234618 Jun 16 16:12:48.399258 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 8/14] 10.222.0.88 () {62 vars in 1187 bytes} [Thu Jun 16 16:12:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 2241 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 16:12:48.438569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5db088b0-921b-413f-ac67-6de946a7ecc9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:48.439889 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5db088b0-921b-413f-ac67-6de946a7ecc9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:48.452637 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5db088b0-921b-413f-ac67-6de946a7ecc9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:48.453512 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5db088b0-921b-413f-ac67-6de946a7ecc9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:48.456162 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5db088b0-921b-413f-ac67-6de946a7ecc9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:48.456880 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5db088b0-921b-413f-ac67-6de946a7ecc9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:49.130173 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5db088b0-921b-413f-ac67-6de946a7ecc9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:49.152180 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5db088b0-921b-413f-ac67-6de946a7ecc9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1273 microversion: 2.1 time: 0.750493 Jun 16 16:12:49.163976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 9/15] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:48 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1273 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:49.167152 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b2ade124-470b-4f5d-a17a-3d9ef3afb8d6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:49.169106 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b2ade124-470b-4f5d-a17a-3d9ef3afb8d6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:49.655243 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b2ade124-470b-4f5d-a17a-3d9ef3afb8d6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:49.667583 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b2ade124-470b-4f5d-a17a-3d9ef3afb8d6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:49.671976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b2ade124-470b-4f5d-a17a-3d9ef3afb8d6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:49.679932 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b2ade124-470b-4f5d-a17a-3d9ef3afb8d6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1280 microversion: 2.20 time: 0.517719 Jun 16 16:12:49.694740 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 10/16] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:12:49 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1280 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:12:49.888881 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-af9c27f4-527b-432c-8605-b2fae7ca286f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:12:49.889584 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-af9c27f4-527b-432c-8605-b2fae7ca286f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:12:49.890208 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-af9c27f4-527b-432c-8605-b2fae7ca286f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:12:49.892832 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-af9c27f4-527b-432c-8605-b2fae7ca286f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:12:49.893431 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-af9c27f4-527b-432c-8605-b2fae7ca286f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:12:49.926946 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-af9c27f4-527b-432c-8605-b2fae7ca286f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:49.929996 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-af9c27f4-527b-432c-8605-b2fae7ca286f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:49.933075 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-af9c27f4-527b-432c-8605-b2fae7ca286f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:49.935581 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-af9c27f4-527b-432c-8605-b2fae7ca286f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:50.002540 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-af9c27f4-527b-432c-8605-b2fae7ca286f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Getting quotas for project c3592ee016d1486db983b4ff2aab5ca3. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:12:50.017639 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-af9c27f4-527b-432c-8605-b2fae7ca286f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Getting quotas for user 16b8389777744e6581ad14be85731f4a and project c3592ee016d1486db983b4ff2aab5ca3. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:12:50.071305 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-af9c27f4-527b-432c-8605-b2fae7ca286f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:12:50.080825 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-af9c27f4-527b-432c-8605-b2fae7ca286f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2716dc1-3d4d-4f62-b0af-c38986f2a3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:12:50.179837 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-081abdbd-c0cc-4be5-9325-221ffd4786a6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:50.182214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-081abdbd-c0cc-4be5-9325-221ffd4786a6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:50.211507 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-081abdbd-c0cc-4be5-9325-221ffd4786a6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:50.214422 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-081abdbd-c0cc-4be5-9325-221ffd4786a6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:50.219858 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-081abdbd-c0cc-4be5-9325-221ffd4786a6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:50.225053 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-081abdbd-c0cc-4be5-9325-221ffd4786a6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:50.264540 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-af9c27f4-527b-432c-8605-b2fae7ca286f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.412347 Jun 16 16:12:50.274822 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 7/17] 10.222.0.88 () {60 vars in 1146 bytes} [Thu Jun 16 16:12:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 3423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 16:12:50.298661 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8de67b2f-db0d-4d4d-bf6c-9089c7c144b7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:50.304809 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8de67b2f-db0d-4d4d-bf6c-9089c7c144b7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:50.879984 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-081abdbd-c0cc-4be5-9325-221ffd4786a6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:50.901174 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-081abdbd-c0cc-4be5-9325-221ffd4786a6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1273 microversion: 2.1 time: 0.727922 Jun 16 16:12:50.902403 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 11/18] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:50 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1273 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:50.923782 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1dc10f8a-0e62-44b0-88b4-eb9601981ace tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:50.926649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1dc10f8a-0e62-44b0-88b4-eb9601981ace tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:50.953923 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1dc10f8a-0e62-44b0-88b4-eb9601981ace tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:50.954786 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1dc10f8a-0e62-44b0-88b4-eb9601981ace tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:50.955824 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1dc10f8a-0e62-44b0-88b4-eb9601981ace tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:50.956547 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1dc10f8a-0e62-44b0-88b4-eb9601981ace tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:50.998258 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8de67b2f-db0d-4d4d-bf6c-9089c7c144b7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:51.014283 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8de67b2f-db0d-4d4d-bf6c-9089c7c144b7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1222 microversion: 2.1 time: 0.737035 Jun 16 16:12:51.016194 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 8/19] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:50 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1222 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:51.174531 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1dc10f8a-0e62-44b0-88b4-eb9601981ace tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:51.207050 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1dc10f8a-0e62-44b0-88b4-eb9601981ace tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:51.207050 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1dc10f8a-0e62-44b0-88b4-eb9601981ace tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:51.207050 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1dc10f8a-0e62-44b0-88b4-eb9601981ace tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1338 microversion: 2.20 time: 0.283069 Jun 16 16:12:51.208982 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 12/20] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:12:50 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1338 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:12:51.923481 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a520a6b8-a6b7-463a-82de-be3833c3b981 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:51.924225 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a520a6b8-a6b7-463a-82de-be3833c3b981 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:51.960003 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a520a6b8-a6b7-463a-82de-be3833c3b981 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:51.960537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a520a6b8-a6b7-463a-82de-be3833c3b981 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:51.961689 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a520a6b8-a6b7-463a-82de-be3833c3b981 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:51.962173 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a520a6b8-a6b7-463a-82de-be3833c3b981 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:52.036163 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ff0dfce4-b183-4b14-b78a-7b37800a1251 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:52.036792 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ff0dfce4-b183-4b14-b78a-7b37800a1251 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:52.056881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ff0dfce4-b183-4b14-b78a-7b37800a1251 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:52.057498 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ff0dfce4-b183-4b14-b78a-7b37800a1251 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:52.073779 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ff0dfce4-b183-4b14-b78a-7b37800a1251 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:52.074616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ff0dfce4-b183-4b14-b78a-7b37800a1251 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:52.483682 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ff0dfce4-b183-4b14-b78a-7b37800a1251 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:52.491904 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ff0dfce4-b183-4b14-b78a-7b37800a1251 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1218 microversion: 2.1 time: 0.461549 Jun 16 16:12:52.504324 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 13/21] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:52 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1218 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:52.528799 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-702c3829-1233-479a-b5cf-0ad5c9cb174f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:52.529651 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-702c3829-1233-479a-b5cf-0ad5c9cb174f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:52.573339 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-702c3829-1233-479a-b5cf-0ad5c9cb174f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:52.574875 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-702c3829-1233-479a-b5cf-0ad5c9cb174f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:52.581015 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-702c3829-1233-479a-b5cf-0ad5c9cb174f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:52.583859 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-702c3829-1233-479a-b5cf-0ad5c9cb174f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:52.669228 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a520a6b8-a6b7-463a-82de-be3833c3b981 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:52.744063 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a520a6b8-a6b7-463a-82de-be3833c3b981 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1273 microversion: 2.1 time: 0.818606 Jun 16 16:12:52.744711 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 9/22] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:51 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1273 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:12:53.160026 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-702c3829-1233-479a-b5cf-0ad5c9cb174f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:53.176578 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-702c3829-1233-479a-b5cf-0ad5c9cb174f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:53.178749 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-702c3829-1233-479a-b5cf-0ad5c9cb174f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:53.180148 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-702c3829-1233-479a-b5cf-0ad5c9cb174f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1338 microversion: 2.20 time: 0.674789 Jun 16 16:12:53.183702 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 14/23] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:12:52 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1338 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:12:53.514409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f7c928b7-2f72-426b-938e-062c7ee6191d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:53.515004 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f7c928b7-2f72-426b-938e-062c7ee6191d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:53.534811 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f7c928b7-2f72-426b-938e-062c7ee6191d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:53.535280 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f7c928b7-2f72-426b-938e-062c7ee6191d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:53.539913 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f7c928b7-2f72-426b-938e-062c7ee6191d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:53.545824 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f7c928b7-2f72-426b-938e-062c7ee6191d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:53.762565 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-aa0ec0a8-ee17-4d35-97d4-f77f1175cc99 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:53.769557 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-aa0ec0a8-ee17-4d35-97d4-f77f1175cc99 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:53.795895 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-aa0ec0a8-ee17-4d35-97d4-f77f1175cc99 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:53.807611 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-aa0ec0a8-ee17-4d35-97d4-f77f1175cc99 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:53.808381 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-aa0ec0a8-ee17-4d35-97d4-f77f1175cc99 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:53.815688 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-aa0ec0a8-ee17-4d35-97d4-f77f1175cc99 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:54.307961 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f7c928b7-2f72-426b-938e-062c7ee6191d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:54.318696 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f7c928b7-2f72-426b-938e-062c7ee6191d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1280 microversion: 2.1 time: 0.809586 Jun 16 16:12:54.349249 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 10/24] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:53 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1280 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:54.373529 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8fd676ab-2fbc-4974-8676-95d38a05ce8f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:54.379655 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8fd676ab-2fbc-4974-8676-95d38a05ce8f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:54.408714 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8fd676ab-2fbc-4974-8676-95d38a05ce8f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:54.412712 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8fd676ab-2fbc-4974-8676-95d38a05ce8f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:54.414268 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8fd676ab-2fbc-4974-8676-95d38a05ce8f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:54.415181 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8fd676ab-2fbc-4974-8676-95d38a05ce8f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:55.249828 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-aa0ec0a8-ee17-4d35-97d4-f77f1175cc99 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:55.264931 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-aa0ec0a8-ee17-4d35-97d4-f77f1175cc99 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1273 microversion: 2.1 time: 1.506996 Jun 16 16:12:55.277058 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 15/25] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:53 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1273 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:55.321399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8fd676ab-2fbc-4974-8676-95d38a05ce8f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:55.348884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8fd676ab-2fbc-4974-8676-95d38a05ce8f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:55.367671 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bec59b2c-429c-449b-8e9b-5ef094d455e3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:55.369400 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-bec59b2c-429c-449b-8e9b-5ef094d455e3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:55.383471 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8fd676ab-2fbc-4974-8676-95d38a05ce8f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:55.393012 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8fd676ab-2fbc-4974-8676-95d38a05ce8f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1338 microversion: 2.20 time: 1.042207 Jun 16 16:12:55.408009 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 11/26] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:12:54 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1338 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:12:55.422842 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bec59b2c-429c-449b-8e9b-5ef094d455e3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:55.429886 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bec59b2c-429c-449b-8e9b-5ef094d455e3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:55.430645 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bec59b2c-429c-449b-8e9b-5ef094d455e3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:55.431106 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bec59b2c-429c-449b-8e9b-5ef094d455e3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:56.300988 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-adfa3ef4-fde7-4d53-8399-1db08dcff973 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:56.322575 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-adfa3ef4-fde7-4d53-8399-1db08dcff973 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:56.363994 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-adfa3ef4-fde7-4d53-8399-1db08dcff973 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:56.364746 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-adfa3ef4-fde7-4d53-8399-1db08dcff973 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:56.366121 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-adfa3ef4-fde7-4d53-8399-1db08dcff973 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:56.366866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-adfa3ef4-fde7-4d53-8399-1db08dcff973 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:57.590531 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-adfa3ef4-fde7-4d53-8399-1db08dcff973 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:57.612565 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-adfa3ef4-fde7-4d53-8399-1db08dcff973 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1273 microversion: 2.1 time: 1.316977 Jun 16 16:12:57.616626 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 12/27] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:56 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1273 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:57.639459 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-86e21779-b746-49d5-83b9-db8b07a5b46b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:57.640604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-86e21779-b746-49d5-83b9-db8b07a5b46b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:57.653584 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-86e21779-b746-49d5-83b9-db8b07a5b46b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:57.657395 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-86e21779-b746-49d5-83b9-db8b07a5b46b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:57.660712 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-86e21779-b746-49d5-83b9-db8b07a5b46b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:57.661394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-86e21779-b746-49d5-83b9-db8b07a5b46b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:58.097584 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=4 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:58.349436 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bec59b2c-429c-449b-8e9b-5ef094d455e3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:58.354417 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-86e21779-b746-49d5-83b9-db8b07a5b46b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:58.359290 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-bec59b2c-429c-449b-8e9b-5ef094d455e3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 2.998036 Jun 16 16:12:58.374920 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 16/28] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:55 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 3004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:12:58.375144 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-86e21779-b746-49d5-83b9-db8b07a5b46b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:58.379382 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-86e21779-b746-49d5-83b9-db8b07a5b46b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:12:58.385918 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-86e21779-b746-49d5-83b9-db8b07a5b46b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1338 microversion: 2.20 time: 0.763287 Jun 16 16:12:58.387495 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 13/29] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:12:57 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1338 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:12:58.633245 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7d0e5e3a-b3db-45bc-8e07-c72d0ec52bcc tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:58.635106 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7d0e5e3a-b3db-45bc-8e07-c72d0ec52bcc tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:58.682676 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7d0e5e3a-b3db-45bc-8e07-c72d0ec52bcc tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:58.684142 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7d0e5e3a-b3db-45bc-8e07-c72d0ec52bcc tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:58.693695 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7d0e5e3a-b3db-45bc-8e07-c72d0ec52bcc tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:58.697844 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7d0e5e3a-b3db-45bc-8e07-c72d0ec52bcc tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:59.176233 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-a2c104bb-d214-483e-b6e1-23744bee5491 req-fe55e7d0-6034-40ca-ad88-dc86a95575e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1", "tag": "52a71ee6-44fd-4a71-b587-86f364e02e17"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:12:59.244021 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-a2c104bb-d214-483e-b6e1-23744bee5491 req-fe55e7d0-6034-40ca-ad88-dc86a95575e3 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:59.244521 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-a2c104bb-d214-483e-b6e1-23744bee5491 req-fe55e7d0-6034-40ca-ad88-dc86a95575e3 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:59.337823 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-a2c104bb-d214-483e-b6e1-23744bee5491 req-fe55e7d0-6034-40ca-ad88-dc86a95575e3 service nova] Creating event network-changed:52a71ee6-44fd-4a71-b587-86f364e02e17 for instance 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 on hv-cinder-83735 Jun 16 16:12:59.338303 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-a2c104bb-d214-483e-b6e1-23744bee5491 req-fe55e7d0-6034-40ca-ad88-dc86a95575e3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117712) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 16:12:59.346164 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0e9b32d8-9e4b-42b5-945c-6a02c6f29a5f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:59.349075 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0e9b32d8-9e4b-42b5-945c-6a02c6f29a5f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:59.353260 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0e9b32d8-9e4b-42b5-945c-6a02c6f29a5f None None] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:59.353991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0e9b32d8-9e4b-42b5-945c-6a02c6f29a5f None None] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:59.382964 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.compute.rpcapi [None req-0e9b32d8-9e4b-42b5-945c-6a02c6f29a5f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 16:12:59.384520 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0e9b32d8-9e4b-42b5-945c-6a02c6f29a5f None None] Releasing lock "compute-rpcapi-router" {{(pid=117712) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 16:12:59.458517 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0e9b32d8-9e4b-42b5-945c-6a02c6f29a5f None None] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.495988 Jun 16 16:12:59.459705 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 14/30] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:12:59.467792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1994f688-10d1-471a-a4b6-765c38c24256 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:12:59.475906 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1994f688-10d1-471a-a4b6-765c38c24256 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:12:59.515040 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1994f688-10d1-471a-a4b6-765c38c24256 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:59.515510 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1994f688-10d1-471a-a4b6-765c38c24256 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:59.525556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1994f688-10d1-471a-a4b6-765c38c24256 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:12:59.527033 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1994f688-10d1-471a-a4b6-765c38c24256 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:12:59.660700 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=22 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:00.358924 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7d0e5e3a-b3db-45bc-8e07-c72d0ec52bcc tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:00.374354 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7d0e5e3a-b3db-45bc-8e07-c72d0ec52bcc tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 1.747163 Jun 16 16:13:00.389239 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 17/31] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:58 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:00.414111 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3eb7b745-897d-4789-b8bf-9e4dc3777d75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:00.416380 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3eb7b745-897d-4789-b8bf-9e4dc3777d75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:00.440690 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3eb7b745-897d-4789-b8bf-9e4dc3777d75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:00.443301 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3eb7b745-897d-4789-b8bf-9e4dc3777d75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:00.444668 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3eb7b745-897d-4789-b8bf-9e4dc3777d75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:00.447308 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3eb7b745-897d-4789-b8bf-9e4dc3777d75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:00.502946 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1994f688-10d1-471a-a4b6-765c38c24256 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:00.511633 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1994f688-10d1-471a-a4b6-765c38c24256 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 1.049889 Jun 16 16:13:00.516829 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 15/32] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:12:59 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:00.540722 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-90df8151-3ff9-49b8-b048-20c09c311b04 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1264873259", "imageRef": "d2716dc1-3d4d-4f62-b0af-c38986f2a3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4704a63-fabf-4303-b16d-892673b27ab3"}], "security_groups": [{"name": "tempest-securitygroup--439529329"}], "key_name": "tempest-keypair-1170520403", "user_data": "}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:01.015518 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=20 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:01.035410 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-90df8151-3ff9-49b8-b048-20c09c311b04 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] validate_networks() for [('b4704a63-fabf-4303-b16d-892673b27ab3', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:13:01.100021 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3eb7b745-897d-4789-b8bf-9e4dc3777d75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:01.110496 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3eb7b745-897d-4789-b8bf-9e4dc3777d75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:01.112429 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3eb7b745-897d-4789-b8bf-9e4dc3777d75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:01.114005 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3eb7b745-897d-4789-b8bf-9e4dc3777d75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.721490 Jun 16 16:13:01.114714 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 18/33] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:00 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:01.400897 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2297ff39-7d96-47bb-9507-dba053586595 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:01.401847 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2297ff39-7d96-47bb-9507-dba053586595 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:01.421506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2297ff39-7d96-47bb-9507-dba053586595 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:01.423475 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2297ff39-7d96-47bb-9507-dba053586595 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:01.426137 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2297ff39-7d96-47bb-9507-dba053586595 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:01.427045 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2297ff39-7d96-47bb-9507-dba053586595 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:01.973518 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2297ff39-7d96-47bb-9507-dba053586595 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:01.985040 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2297ff39-7d96-47bb-9507-dba053586595 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.592448 Jun 16 16:13:01.986183 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 19/34] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:01 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:01.996305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1ae0d33f-1026-414c-9cd0-ca4d5d01e0b0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:01.997130 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1ae0d33f-1026-414c-9cd0-ca4d5d01e0b0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:02.010444 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1ae0d33f-1026-414c-9cd0-ca4d5d01e0b0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:02.011097 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1ae0d33f-1026-414c-9cd0-ca4d5d01e0b0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:02.012393 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1ae0d33f-1026-414c-9cd0-ca4d5d01e0b0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:02.012827 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1ae0d33f-1026-414c-9cd0-ca4d5d01e0b0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:02.228324 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-90df8151-3ff9-49b8-b048-20c09c311b04 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:13:02.228822 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-90df8151-3ff9-49b8-b048-20c09c311b04 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:13:02.229282 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-90df8151-3ff9-49b8-b048-20c09c311b04 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:13:02.229622 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-90df8151-3ff9-49b8-b048-20c09c311b04 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:13:02.230060 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-90df8151-3ff9-49b8-b048-20c09c311b04 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:13:02.244240 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-90df8151-3ff9-49b8-b048-20c09c311b04 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:02.246277 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-90df8151-3ff9-49b8-b048-20c09c311b04 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:02.247474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-90df8151-3ff9-49b8-b048-20c09c311b04 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:02.248105 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-90df8151-3ff9-49b8-b048-20c09c311b04 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:02.259461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1ae0d33f-1026-414c-9cd0-ca4d5d01e0b0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:02.269970 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1ae0d33f-1026-414c-9cd0-ca4d5d01e0b0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.282616 Jun 16 16:13:02.272785 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 20/35] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:01 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:02.295556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-90df8151-3ff9-49b8-b048-20c09c311b04 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Getting quotas for project c1cdf363c2e44af5b0d8cd748c58235b. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:13:02.303227 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-90df8151-3ff9-49b8-b048-20c09c311b04 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Getting quotas for user bfbcc9b45bc341228bcc0f2192040224 and project c1cdf363c2e44af5b0d8cd748c58235b. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:13:02.331495 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-90df8151-3ff9-49b8-b048-20c09c311b04 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:13:02.336040 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-90df8151-3ff9-49b8-b048-20c09c311b04 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2716dc1-3d4d-4f62-b0af-c38986f2a3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:13:02.433874 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-90df8151-3ff9-49b8-b048-20c09c311b04 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.913182 Jun 16 16:13:02.439618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 16/36] 10.222.0.88 () {60 vars in 1146 bytes} [Thu Jun 16 16:13:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 1922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:13:02.451765 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d5d3f0e3-702d-48f8-8c45-91781909206a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:02.452580 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d5d3f0e3-702d-48f8-8c45-91781909206a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:02.461350 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d5d3f0e3-702d-48f8-8c45-91781909206a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:02.462012 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d5d3f0e3-702d-48f8-8c45-91781909206a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:02.463114 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d5d3f0e3-702d-48f8-8c45-91781909206a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:02.463703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d5d3f0e3-702d-48f8-8c45-91781909206a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:02.472156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-82f6046e-d582-4167-9413-e33123088ce0 req-909a56dc-db37-4ec3-958b-3ca3ee13d8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c1389bc-ae98-44d1-943a-669b44dde9ad", "tag": "9fc73dbb-a75c-415a-b8f8-fbf849262a05"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:02.512359 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-82f6046e-d582-4167-9413-e33123088ce0 req-909a56dc-db37-4ec3-958b-3ca3ee13d8d2 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:02.512816 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-82f6046e-d582-4167-9413-e33123088ce0 req-909a56dc-db37-4ec3-958b-3ca3ee13d8d2 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:02.569054 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-82f6046e-d582-4167-9413-e33123088ce0 req-909a56dc-db37-4ec3-958b-3ca3ee13d8d2 service nova] Creating event network-changed:9fc73dbb-a75c-415a-b8f8-fbf849262a05 for instance 7c1389bc-ae98-44d1-943a-669b44dde9ad on hv-cinder-83735 Jun 16 16:13:02.570066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-82f6046e-d582-4167-9413-e33123088ce0 req-909a56dc-db37-4ec3-958b-3ca3ee13d8d2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117711) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 16:13:02.571967 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-173c28ac-cb37-4e89-bae2-493e0541dc0a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:02.572590 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-173c28ac-cb37-4e89-bae2-493e0541dc0a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:02.573546 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-173c28ac-cb37-4e89-bae2-493e0541dc0a None None] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:02.574742 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-173c28ac-cb37-4e89-bae2-493e0541dc0a None None] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:02.592720 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.compute.rpcapi [None req-173c28ac-cb37-4e89-bae2-493e0541dc0a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 16:13:02.593998 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-173c28ac-cb37-4e89-bae2-493e0541dc0a None None] Releasing lock "compute-rpcapi-router" {{(pid=117711) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 16:13:02.648826 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-173c28ac-cb37-4e89-bae2-493e0541dc0a None None] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.373166 Jun 16 16:13:02.649662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 21/37] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:13:02.656756 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-67607c73-0ba1-4aa6-9fde-78689e6bc381 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:02.657509 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-67607c73-0ba1-4aa6-9fde-78689e6bc381 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:02.745465 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d5d3f0e3-702d-48f8-8c45-91781909206a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:02.759395 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d5d3f0e3-702d-48f8-8c45-91781909206a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:02.760929 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d5d3f0e3-702d-48f8-8c45-91781909206a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:02.766712 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d5d3f0e3-702d-48f8-8c45-91781909206a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.325589 Jun 16 16:13:02.770020 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 17/38] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:02 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:02.790341 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-67607c73-0ba1-4aa6-9fde-78689e6bc381 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:02.801988 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-67607c73-0ba1-4aa6-9fde-78689e6bc381 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1242 microversion: 2.1 time: 0.150508 Jun 16 16:13:02.814603 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 22/39] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:02 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1242 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:03.003469 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6261822f-de7c-444a-b64f-039826402720 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:03.007173 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6261822f-de7c-444a-b64f-039826402720 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:03.019115 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6261822f-de7c-444a-b64f-039826402720 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:03.019649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6261822f-de7c-444a-b64f-039826402720 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:03.020794 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6261822f-de7c-444a-b64f-039826402720 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:03.021497 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6261822f-de7c-444a-b64f-039826402720 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:03.194520 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6261822f-de7c-444a-b64f-039826402720 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:03.202543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6261822f-de7c-444a-b64f-039826402720 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.203007 Jun 16 16:13:03.203115 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 18/40] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:02 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:03.290828 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-42406a43-8380-40cd-a3f9-d780e9ff913e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:03.291845 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-42406a43-8380-40cd-a3f9-d780e9ff913e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:03.300387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-42406a43-8380-40cd-a3f9-d780e9ff913e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:03.300387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-42406a43-8380-40cd-a3f9-d780e9ff913e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:03.300799 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-42406a43-8380-40cd-a3f9-d780e9ff913e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:03.301449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-42406a43-8380-40cd-a3f9-d780e9ff913e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:03.553318 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-42406a43-8380-40cd-a3f9-d780e9ff913e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:03.562661 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-42406a43-8380-40cd-a3f9-d780e9ff913e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.276035 Jun 16 16:13:03.563802 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 23/41] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:03 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:03.821769 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-794dbc69-d001-44d5-999f-b0872eedfee8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:03.823152 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e4fc2c55-da7c-410d-8ad8-b626b5f262d7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:03.824477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e4fc2c55-da7c-410d-8ad8-b626b5f262d7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:03.824943 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-794dbc69-d001-44d5-999f-b0872eedfee8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:03.842989 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e4fc2c55-da7c-410d-8ad8-b626b5f262d7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:03.843711 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e4fc2c55-da7c-410d-8ad8-b626b5f262d7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:03.844725 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e4fc2c55-da7c-410d-8ad8-b626b5f262d7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:03.845375 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e4fc2c55-da7c-410d-8ad8-b626b5f262d7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:03.846807 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-794dbc69-d001-44d5-999f-b0872eedfee8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:03.847272 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-794dbc69-d001-44d5-999f-b0872eedfee8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:03.854385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-794dbc69-d001-44d5-999f-b0872eedfee8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:03.856526 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-794dbc69-d001-44d5-999f-b0872eedfee8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:04.048228 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-794dbc69-d001-44d5-999f-b0872eedfee8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:04.073038 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-794dbc69-d001-44d5-999f-b0872eedfee8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1246 microversion: 2.1 time: 0.256413 Jun 16 16:13:04.073629 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 24/42] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:03 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1246 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:04.181314 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e4fc2c55-da7c-410d-8ad8-b626b5f262d7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:04.190638 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e4fc2c55-da7c-410d-8ad8-b626b5f262d7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:04.192713 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e4fc2c55-da7c-410d-8ad8-b626b5f262d7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:04.194151 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e4fc2c55-da7c-410d-8ad8-b626b5f262d7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.399387 Jun 16 16:13:04.195248 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 19/43] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:03 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:04.220446 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6f3818db-891d-4c0f-be98-8c454b282d4a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:04.221593 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6f3818db-891d-4c0f-be98-8c454b282d4a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:04.227872 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6f3818db-891d-4c0f-be98-8c454b282d4a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:04.228405 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6f3818db-891d-4c0f-be98-8c454b282d4a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:04.229243 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6f3818db-891d-4c0f-be98-8c454b282d4a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:04.229784 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6f3818db-891d-4c0f-be98-8c454b282d4a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:04.388707 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6f3818db-891d-4c0f-be98-8c454b282d4a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:04.397944 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6f3818db-891d-4c0f-be98-8c454b282d4a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.181315 Jun 16 16:13:04.398555 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 25/44] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:04 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:04.582961 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-72a828d1-3351-4dac-9e52-39dc70ea5b56 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:04.583765 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-72a828d1-3351-4dac-9e52-39dc70ea5b56 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:04.592687 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-72a828d1-3351-4dac-9e52-39dc70ea5b56 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:04.593243 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-72a828d1-3351-4dac-9e52-39dc70ea5b56 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:04.594164 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-72a828d1-3351-4dac-9e52-39dc70ea5b56 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:04.594678 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-72a828d1-3351-4dac-9e52-39dc70ea5b56 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:04.776725 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-72a828d1-3351-4dac-9e52-39dc70ea5b56 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:04.843590 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-72a828d1-3351-4dac-9e52-39dc70ea5b56 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.265803 Jun 16 16:13:04.853494 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 20/45] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:04 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:05.098793 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-33124dff-bb12-4b9e-9212-d15861fa52f5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:05.099705 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-33124dff-bb12-4b9e-9212-d15861fa52f5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:05.107219 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-33124dff-bb12-4b9e-9212-d15861fa52f5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:05.108061 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-33124dff-bb12-4b9e-9212-d15861fa52f5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:05.109077 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-33124dff-bb12-4b9e-9212-d15861fa52f5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:05.109753 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-33124dff-bb12-4b9e-9212-d15861fa52f5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:05.227515 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ab634a26-42e7-48ac-ae42-df3639c9750d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:05.228816 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ab634a26-42e7-48ac-ae42-df3639c9750d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:05.237850 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ab634a26-42e7-48ac-ae42-df3639c9750d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:05.238782 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ab634a26-42e7-48ac-ae42-df3639c9750d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:05.240233 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ab634a26-42e7-48ac-ae42-df3639c9750d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:05.241196 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ab634a26-42e7-48ac-ae42-df3639c9750d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:05.262362 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-33124dff-bb12-4b9e-9212-d15861fa52f5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:05.277447 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-33124dff-bb12-4b9e-9212-d15861fa52f5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1246 microversion: 2.1 time: 0.182210 Jun 16 16:13:05.291593 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 26/46] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:05 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1246 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:05.418747 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d6564cd3-1b0e-46da-a8e1-9fa3e2a86dd1 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:05.420743 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d6564cd3-1b0e-46da-a8e1-9fa3e2a86dd1 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:05.439127 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d6564cd3-1b0e-46da-a8e1-9fa3e2a86dd1 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:05.440936 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d6564cd3-1b0e-46da-a8e1-9fa3e2a86dd1 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:05.443904 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d6564cd3-1b0e-46da-a8e1-9fa3e2a86dd1 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:05.447430 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d6564cd3-1b0e-46da-a8e1-9fa3e2a86dd1 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:05.457902 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=100 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:05.606561 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ab634a26-42e7-48ac-ae42-df3639c9750d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:05.617907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ab634a26-42e7-48ac-ae42-df3639c9750d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:05.619699 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ab634a26-42e7-48ac-ae42-df3639c9750d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:05.621024 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ab634a26-42e7-48ac-ae42-df3639c9750d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.411547 Jun 16 16:13:05.632306 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 21/47] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:05 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:05.706294 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d6564cd3-1b0e-46da-a8e1-9fa3e2a86dd1 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:05.715339 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d6564cd3-1b0e-46da-a8e1-9fa3e2a86dd1 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.302299 Jun 16 16:13:05.719465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 27/48] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:05 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:05.861208 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ff0d7c6c-3cdc-4970-a246-9eff906f91c6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:05.862043 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ff0d7c6c-3cdc-4970-a246-9eff906f91c6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:05.869062 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ff0d7c6c-3cdc-4970-a246-9eff906f91c6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:05.869509 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ff0d7c6c-3cdc-4970-a246-9eff906f91c6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:05.870357 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ff0d7c6c-3cdc-4970-a246-9eff906f91c6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:05.871319 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ff0d7c6c-3cdc-4970-a246-9eff906f91c6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:06.122990 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ff0d7c6c-3cdc-4970-a246-9eff906f91c6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:06.133398 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ff0d7c6c-3cdc-4970-a246-9eff906f91c6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.276556 Jun 16 16:13:06.134036 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 22/49] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:05 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:06.308250 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-38ce66fa-0ed9-4227-9c81-b6c61b8f3431 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:06.309199 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-38ce66fa-0ed9-4227-9c81-b6c61b8f3431 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:06.315658 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-38ce66fa-0ed9-4227-9c81-b6c61b8f3431 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:06.316302 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-38ce66fa-0ed9-4227-9c81-b6c61b8f3431 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:06.317230 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-38ce66fa-0ed9-4227-9c81-b6c61b8f3431 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:06.317862 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-38ce66fa-0ed9-4227-9c81-b6c61b8f3431 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:06.409468 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-38ce66fa-0ed9-4227-9c81-b6c61b8f3431 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:06.421422 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-38ce66fa-0ed9-4227-9c81-b6c61b8f3431 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1246 microversion: 2.1 time: 0.117016 Jun 16 16:13:06.422594 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 28/50] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:06 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1246 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:06.640276 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8fabebaa-6b87-4e29-b939-85687d0f2a4f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:06.640810 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8fabebaa-6b87-4e29-b939-85687d0f2a4f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:06.647253 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8fabebaa-6b87-4e29-b939-85687d0f2a4f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:06.647980 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8fabebaa-6b87-4e29-b939-85687d0f2a4f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:06.648921 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8fabebaa-6b87-4e29-b939-85687d0f2a4f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:06.649560 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8fabebaa-6b87-4e29-b939-85687d0f2a4f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:06.733563 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-73df4bfc-dcd9-4874-a51a-0ce7763a7278 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:06.734477 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-73df4bfc-dcd9-4874-a51a-0ce7763a7278 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:06.743336 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:06.747589 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-73df4bfc-dcd9-4874-a51a-0ce7763a7278 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:06.757075 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-73df4bfc-dcd9-4874-a51a-0ce7763a7278 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:06.765349 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-73df4bfc-dcd9-4874-a51a-0ce7763a7278 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:06.766640 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-73df4bfc-dcd9-4874-a51a-0ce7763a7278 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:06.920297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8fabebaa-6b87-4e29-b939-85687d0f2a4f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:06.929293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8fabebaa-6b87-4e29-b939-85687d0f2a4f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:06.930841 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8fabebaa-6b87-4e29-b939-85687d0f2a4f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:06.940662 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8fabebaa-6b87-4e29-b939-85687d0f2a4f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.305035 Jun 16 16:13:06.941482 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 23/51] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:06 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:07.068822 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-73df4bfc-dcd9-4874-a51a-0ce7763a7278 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:07.083482 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-73df4bfc-dcd9-4874-a51a-0ce7763a7278 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.354211 Jun 16 16:13:07.084423 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 29/52] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:06 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:07.152675 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-686e334e-dca9-4685-b489-03e76812eaee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:07.153545 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-686e334e-dca9-4685-b489-03e76812eaee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:07.164882 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:07.176213 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-686e334e-dca9-4685-b489-03e76812eaee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:07.178206 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-686e334e-dca9-4685-b489-03e76812eaee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:07.181136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-686e334e-dca9-4685-b489-03e76812eaee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:07.182289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-686e334e-dca9-4685-b489-03e76812eaee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:07.442952 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ec889271-a288-4416-b489-a93fb8746eb0 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:07.449185 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ec889271-a288-4416-b489-a93fb8746eb0 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:07.459905 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ec889271-a288-4416-b489-a93fb8746eb0 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:07.460348 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ec889271-a288-4416-b489-a93fb8746eb0 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:07.461140 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ec889271-a288-4416-b489-a93fb8746eb0 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:07.461578 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ec889271-a288-4416-b489-a93fb8746eb0 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:07.535451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-686e334e-dca9-4685-b489-03e76812eaee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:07.550336 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-686e334e-dca9-4685-b489-03e76812eaee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.403421 Jun 16 16:13:07.552472 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 24/53] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:07 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:07.616337 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ec889271-a288-4416-b489-a93fb8746eb0 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:07.627420 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ec889271-a288-4416-b489-a93fb8746eb0 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1246 microversion: 2.1 time: 0.188426 Jun 16 16:13:07.628313 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 30/54] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:07 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1246 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:07.967488 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0deb796e-c6d4-4fb8-9927-1c0cc6bdabd3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:07.969897 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0deb796e-c6d4-4fb8-9927-1c0cc6bdabd3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:07.983867 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0deb796e-c6d4-4fb8-9927-1c0cc6bdabd3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:07.990314 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0deb796e-c6d4-4fb8-9927-1c0cc6bdabd3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:07.992959 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0deb796e-c6d4-4fb8-9927-1c0cc6bdabd3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:07.993612 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0deb796e-c6d4-4fb8-9927-1c0cc6bdabd3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:08.103835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b98e0e6d-2071-403c-b16f-f0abd00d9586 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:08.104443 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b98e0e6d-2071-403c-b16f-f0abd00d9586 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:08.140216 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b98e0e6d-2071-403c-b16f-f0abd00d9586 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:08.142259 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b98e0e6d-2071-403c-b16f-f0abd00d9586 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:08.145007 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b98e0e6d-2071-403c-b16f-f0abd00d9586 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:08.145635 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b98e0e6d-2071-403c-b16f-f0abd00d9586 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:08.217629 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0deb796e-c6d4-4fb8-9927-1c0cc6bdabd3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:08.224604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=100 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:08.233849 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0deb796e-c6d4-4fb8-9927-1c0cc6bdabd3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:08.236567 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0deb796e-c6d4-4fb8-9927-1c0cc6bdabd3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:08.250355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0deb796e-c6d4-4fb8-9927-1c0cc6bdabd3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.292268 Jun 16 16:13:08.253833 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 25/55] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:07 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:08.547669 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b98e0e6d-2071-403c-b16f-f0abd00d9586 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:08.564238 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b98e0e6d-2071-403c-b16f-f0abd00d9586 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.464317 Jun 16 16:13:08.571087 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 31/56] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:08 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:08.577162 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7cf8c029-fa7f-41f8-94af-1f0b916c7b17 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:08.578208 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7cf8c029-fa7f-41f8-94af-1f0b916c7b17 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:08.590428 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7cf8c029-fa7f-41f8-94af-1f0b916c7b17 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:08.591214 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7cf8c029-fa7f-41f8-94af-1f0b916c7b17 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:08.606587 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7cf8c029-fa7f-41f8-94af-1f0b916c7b17 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:08.607180 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7cf8c029-fa7f-41f8-94af-1f0b916c7b17 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:08.652498 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2944272f-ccd8-4587-89b8-c5d9c2c56f3e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:08.654007 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2944272f-ccd8-4587-89b8-c5d9c2c56f3e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:08.666339 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2944272f-ccd8-4587-89b8-c5d9c2c56f3e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:08.667900 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2944272f-ccd8-4587-89b8-c5d9c2c56f3e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:08.669202 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2944272f-ccd8-4587-89b8-c5d9c2c56f3e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:08.670837 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2944272f-ccd8-4587-89b8-c5d9c2c56f3e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:08.774693 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2944272f-ccd8-4587-89b8-c5d9c2c56f3e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:08.789455 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2944272f-ccd8-4587-89b8-c5d9c2c56f3e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1246 microversion: 2.1 time: 0.144391 Jun 16 16:13:08.790501 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 32/57] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:08 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1246 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:08.833307 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7cf8c029-fa7f-41f8-94af-1f0b916c7b17 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:08.845117 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7cf8c029-fa7f-41f8-94af-1f0b916c7b17 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.276015 Jun 16 16:13:08.845764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 26/58] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:08 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:09.275879 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9d72ecb0-7ae0-43cc-b0f8-aa448f74bc08 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:09.276773 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9d72ecb0-7ae0-43cc-b0f8-aa448f74bc08 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:09.294334 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d72ecb0-7ae0-43cc-b0f8-aa448f74bc08 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:09.294744 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d72ecb0-7ae0-43cc-b0f8-aa448f74bc08 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:09.295512 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d72ecb0-7ae0-43cc-b0f8-aa448f74bc08 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:09.296081 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d72ecb0-7ae0-43cc-b0f8-aa448f74bc08 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:09.468031 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9d72ecb0-7ae0-43cc-b0f8-aa448f74bc08 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:09.478661 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9d72ecb0-7ae0-43cc-b0f8-aa448f74bc08 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:09.479971 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9d72ecb0-7ae0-43cc-b0f8-aa448f74bc08 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:09.481293 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9d72ecb0-7ae0-43cc-b0f8-aa448f74bc08 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.211802 Jun 16 16:13:09.482265 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 33/59] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:09 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:09.587674 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-410954ee-aaef-4632-acd3-2941e19cbeee tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:09.588432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-410954ee-aaef-4632-acd3-2941e19cbeee tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:09.597096 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-410954ee-aaef-4632-acd3-2941e19cbeee tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:09.597910 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-410954ee-aaef-4632-acd3-2941e19cbeee tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:09.598829 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-410954ee-aaef-4632-acd3-2941e19cbeee tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:09.599477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-410954ee-aaef-4632-acd3-2941e19cbeee tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:09.754829 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-410954ee-aaef-4632-acd3-2941e19cbeee tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:09.762826 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-410954ee-aaef-4632-acd3-2941e19cbeee tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.178865 Jun 16 16:13:09.763527 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 27/60] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:09 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:09.807032 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-79abbe52-11f5-428d-9992-e7cf8bd1548f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:09.807743 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-79abbe52-11f5-428d-9992-e7cf8bd1548f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:09.813834 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-79abbe52-11f5-428d-9992-e7cf8bd1548f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:09.814289 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-79abbe52-11f5-428d-9992-e7cf8bd1548f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:09.815050 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-79abbe52-11f5-428d-9992-e7cf8bd1548f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:09.815486 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-79abbe52-11f5-428d-9992-e7cf8bd1548f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:09.862747 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-09b30b00-3685-4410-ac0b-d66530d89b4c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:09.863665 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-09b30b00-3685-4410-ac0b-d66530d89b4c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:09.870290 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-09b30b00-3685-4410-ac0b-d66530d89b4c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:09.870771 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-09b30b00-3685-4410-ac0b-d66530d89b4c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:09.871568 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-09b30b00-3685-4410-ac0b-d66530d89b4c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:09.871995 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-09b30b00-3685-4410-ac0b-d66530d89b4c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:09.886496 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-79abbe52-11f5-428d-9992-e7cf8bd1548f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:09.895551 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-79abbe52-11f5-428d-9992-e7cf8bd1548f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1246 microversion: 2.1 time: 0.092418 Jun 16 16:13:09.896364 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 34/61] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:09 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:10.038864 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-09b30b00-3685-4410-ac0b-d66530d89b4c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:10.048873 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-09b30b00-3685-4410-ac0b-d66530d89b4c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.190093 Jun 16 16:13:10.058546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 28/62] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:09 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:10.506184 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ec69934b-af85-4054-a482-e32ffb0f0bf3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:10.507273 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ec69934b-af85-4054-a482-e32ffb0f0bf3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:10.523195 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ec69934b-af85-4054-a482-e32ffb0f0bf3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:10.523980 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ec69934b-af85-4054-a482-e32ffb0f0bf3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:10.525055 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ec69934b-af85-4054-a482-e32ffb0f0bf3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:10.526519 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ec69934b-af85-4054-a482-e32ffb0f0bf3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:10.783152 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-de846904-669a-4614-b444-fc9401ee4c9d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:10.783776 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-de846904-669a-4614-b444-fc9401ee4c9d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:10.792015 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-de846904-669a-4614-b444-fc9401ee4c9d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:10.792306 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-de846904-669a-4614-b444-fc9401ee4c9d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:10.799131 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-de846904-669a-4614-b444-fc9401ee4c9d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:10.799909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-de846904-669a-4614-b444-fc9401ee4c9d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:11.504734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ec69934b-af85-4054-a482-e32ffb0f0bf3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:11.517869 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ec69934b-af85-4054-a482-e32ffb0f0bf3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:11.519949 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ec69934b-af85-4054-a482-e32ffb0f0bf3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:11.521427 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ec69934b-af85-4054-a482-e32ffb0f0bf3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 1.022112 Jun 16 16:13:11.522274 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 35/63] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:10 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:11.535039 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1902a1df-50bf-4089-94ef-5550d8ca2161 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:11.536029 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1902a1df-50bf-4089-94ef-5550d8ca2161 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:11.545626 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1902a1df-50bf-4089-94ef-5550d8ca2161 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:11.546527 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1902a1df-50bf-4089-94ef-5550d8ca2161 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:11.547591 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1902a1df-50bf-4089-94ef-5550d8ca2161 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:11.548268 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1902a1df-50bf-4089-94ef-5550d8ca2161 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:11.559591 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-de846904-669a-4614-b444-fc9401ee4c9d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:11.571422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-de846904-669a-4614-b444-fc9401ee4c9d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.793833 Jun 16 16:13:11.572270 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 29/64] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:10 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:11.592534 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-224c74f3-8b87-4965-803a-e441dbcaf5ac tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:11.593377 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-224c74f3-8b87-4965-803a-e441dbcaf5ac tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:11.607294 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-224c74f3-8b87-4965-803a-e441dbcaf5ac tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:11.608050 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-224c74f3-8b87-4965-803a-e441dbcaf5ac tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:11.609157 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-224c74f3-8b87-4965-803a-e441dbcaf5ac tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:11.609811 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-224c74f3-8b87-4965-803a-e441dbcaf5ac tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:11.874402 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1902a1df-50bf-4089-94ef-5550d8ca2161 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:11.888199 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1902a1df-50bf-4089-94ef-5550d8ca2161 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1294 microversion: 2.1 time: 0.364631 Jun 16 16:13:11.890422 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 36/65] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:11 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1294 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:12.052076 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-224c74f3-8b87-4965-803a-e441dbcaf5ac tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:12.087073 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-224c74f3-8b87-4965-803a-e441dbcaf5ac tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.506081 Jun 16 16:13:12.089181 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 30/66] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:11 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:12.545267 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-284481e4-ebd3-4f34-834d-d17b38b5494a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:12.546470 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-284481e4-ebd3-4f34-834d-d17b38b5494a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:12.575477 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-284481e4-ebd3-4f34-834d-d17b38b5494a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:12.576006 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-284481e4-ebd3-4f34-834d-d17b38b5494a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:12.576826 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-284481e4-ebd3-4f34-834d-d17b38b5494a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:12.577271 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-284481e4-ebd3-4f34-834d-d17b38b5494a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:12.591399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9d7433cd-8fdc-4577-8ca1-29baa12de99e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:12.592025 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9d7433cd-8fdc-4577-8ca1-29baa12de99e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:12.635461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:12.637348 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=8 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:12.638640 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=6 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:12.655581 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9d7433cd-8fdc-4577-8ca1-29baa12de99e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:12.656021 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9d7433cd-8fdc-4577-8ca1-29baa12de99e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:12.659524 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9d7433cd-8fdc-4577-8ca1-29baa12de99e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:12.664723 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9d7433cd-8fdc-4577-8ca1-29baa12de99e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:12.800664 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:13.178883 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-284481e4-ebd3-4f34-834d-d17b38b5494a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:13.193081 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-284481e4-ebd3-4f34-834d-d17b38b5494a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:13.195256 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-284481e4-ebd3-4f34-834d-d17b38b5494a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:13.202305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-284481e4-ebd3-4f34-834d-d17b38b5494a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.662088 Jun 16 16:13:13.203241 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 37/67] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:12 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:13:13.211754 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-53e9f70c-7f1c-4e31-81ed-5b3c54257702 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:13.212718 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-53e9f70c-7f1c-4e31-81ed-5b3c54257702 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:13.227713 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-53e9f70c-7f1c-4e31-81ed-5b3c54257702 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:13.228157 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-53e9f70c-7f1c-4e31-81ed-5b3c54257702 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:13.233734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-53e9f70c-7f1c-4e31-81ed-5b3c54257702 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:13.234429 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-53e9f70c-7f1c-4e31-81ed-5b3c54257702 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:13.396499 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-53e9f70c-7f1c-4e31-81ed-5b3c54257702 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:13.412147 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-53e9f70c-7f1c-4e31-81ed-5b3c54257702 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1294 microversion: 2.1 time: 0.207692 Jun 16 16:13:13.424875 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 38/68] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:13 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1294 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:13.424875 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-000fb975-5c1c-4dbe-b782-a70f8c33fb0c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:13.424875 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-000fb975-5c1c-4dbe-b782-a70f8c33fb0c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:13.432280 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-000fb975-5c1c-4dbe-b782-a70f8c33fb0c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:13.432731 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-000fb975-5c1c-4dbe-b782-a70f8c33fb0c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:13.434588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-000fb975-5c1c-4dbe-b782-a70f8c33fb0c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:13.435044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-000fb975-5c1c-4dbe-b782-a70f8c33fb0c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:13.441074 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9d7433cd-8fdc-4577-8ca1-29baa12de99e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:13.455702 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9d7433cd-8fdc-4577-8ca1-29baa12de99e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.869091 Jun 16 16:13:13.458426 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 31/69] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:12 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:13.575631 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-0b5a1d8a-2670-415c-a3aa-466830e9434b req-8cfeb59e-7b8e-489f-8022-f3e62775e639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79a464c4-3b6c-48f2-b733-8970ccf82e0d", "tag": "17ff1249-a9c6-473b-9c9c-1c74c01a15cc"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:13.602104 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-0b5a1d8a-2670-415c-a3aa-466830e9434b req-8cfeb59e-7b8e-489f-8022-f3e62775e639 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:13.603249 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-0b5a1d8a-2670-415c-a3aa-466830e9434b req-8cfeb59e-7b8e-489f-8022-f3e62775e639 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:13.622219 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-0b5a1d8a-2670-415c-a3aa-466830e9434b req-8cfeb59e-7b8e-489f-8022-f3e62775e639 service nova] Creating event network-changed:17ff1249-a9c6-473b-9c9c-1c74c01a15cc for instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d on hv-cinder-83735 Jun 16 16:13:13.643028 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-0b5a1d8a-2670-415c-a3aa-466830e9434b req-8cfeb59e-7b8e-489f-8022-f3e62775e639 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071230 Jun 16 16:13:13.647015 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 32/70] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:13:14.054723 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-000fb975-5c1c-4dbe-b782-a70f8c33fb0c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:14.064459 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-000fb975-5c1c-4dbe-b782-a70f8c33fb0c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.649534 Jun 16 16:13:14.067959 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 39/71] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:13 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:14.231574 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-16244a4e-8913-46a8-8502-70f2d5404a93 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:14.236489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-16244a4e-8913-46a8-8502-70f2d5404a93 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:14.256433 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-16244a4e-8913-46a8-8502-70f2d5404a93 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:14.263507 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-16244a4e-8913-46a8-8502-70f2d5404a93 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:14.265274 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-16244a4e-8913-46a8-8502-70f2d5404a93 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:14.271703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-16244a4e-8913-46a8-8502-70f2d5404a93 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:14.434702 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-561ca6dc-115a-47d9-bd93-e89cdd9520b4 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:14.436395 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-561ca6dc-115a-47d9-bd93-e89cdd9520b4 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:14.465213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-561ca6dc-115a-47d9-bd93-e89cdd9520b4 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:14.475985 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-561ca6dc-115a-47d9-bd93-e89cdd9520b4 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:14.479650 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-561ca6dc-115a-47d9-bd93-e89cdd9520b4 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:14.482099 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-561ca6dc-115a-47d9-bd93-e89cdd9520b4 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:14.950156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-561ca6dc-115a-47d9-bd93-e89cdd9520b4 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:14.979417 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-561ca6dc-115a-47d9-bd93-e89cdd9520b4 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1312 microversion: 2.1 time: 0.553153 Jun 16 16:13:14.983722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 40/72] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:14 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1312 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:15.001993 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c1ea7967-1275-4f45-8c7d-52d4f3199745 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:15.022776 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c1ea7967-1275-4f45-8c7d-52d4f3199745 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:15.057239 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c1ea7967-1275-4f45-8c7d-52d4f3199745 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:15.057983 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c1ea7967-1275-4f45-8c7d-52d4f3199745 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:15.059591 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c1ea7967-1275-4f45-8c7d-52d4f3199745 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:15.060076 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c1ea7967-1275-4f45-8c7d-52d4f3199745 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:15.528185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-16244a4e-8913-46a8-8502-70f2d5404a93 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:15.539762 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-16244a4e-8913-46a8-8502-70f2d5404a93 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:15.543152 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-16244a4e-8913-46a8-8502-70f2d5404a93 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:15.550297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-16244a4e-8913-46a8-8502-70f2d5404a93 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 1.326427 Jun 16 16:13:15.551559 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 33/73] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:14 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:15.557686 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-245f7f18-7fa0-440d-8df5-12324c26733d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:15.558779 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-245f7f18-7fa0-440d-8df5-12324c26733d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:15.565349 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-245f7f18-7fa0-440d-8df5-12324c26733d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:15.565886 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-245f7f18-7fa0-440d-8df5-12324c26733d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:15.566660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-245f7f18-7fa0-440d-8df5-12324c26733d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:15.567310 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-245f7f18-7fa0-440d-8df5-12324c26733d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:15.961956 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c1ea7967-1275-4f45-8c7d-52d4f3199745 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:15.977135 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c1ea7967-1275-4f45-8c7d-52d4f3199745 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.986975 Jun 16 16:13:15.977854 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 41/74] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:14 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:15.995713 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-95ac2c51-2efc-4ce0-9376-163872252a18 req-6e44d0b0-6668-4a10-8389-e8807b3edce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31998833-f554-4e9e-8215-6694a9d01970", "tag": "45b1ab78-929d-4b1a-90a1-4777fb503a47"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:16.008916 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-95ac2c51-2efc-4ce0-9376-163872252a18 req-6e44d0b0-6668-4a10-8389-e8807b3edce7 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:16.009697 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-95ac2c51-2efc-4ce0-9376-163872252a18 req-6e44d0b0-6668-4a10-8389-e8807b3edce7 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:16.025590 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-95ac2c51-2efc-4ce0-9376-163872252a18 req-6e44d0b0-6668-4a10-8389-e8807b3edce7 service nova] Creating event network-changed:45b1ab78-929d-4b1a-90a1-4777fb503a47 for instance 31998833-f554-4e9e-8215-6694a9d01970 on hv-cinder-83735 Jun 16 16:13:16.032353 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-95ac2c51-2efc-4ce0-9376-163872252a18 req-6e44d0b0-6668-4a10-8389-e8807b3edce7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042360 Jun 16 16:13:16.033635 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 42/75] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:13:16.041364 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c8fdcc6c-f240-48cf-95c3-97744056e29a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:16.043764 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c8fdcc6c-f240-48cf-95c3-97744056e29a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:16.051606 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c8fdcc6c-f240-48cf-95c3-97744056e29a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:16.052682 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c8fdcc6c-f240-48cf-95c3-97744056e29a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:16.053686 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c8fdcc6c-f240-48cf-95c3-97744056e29a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:16.054374 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c8fdcc6c-f240-48cf-95c3-97744056e29a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:16.380787 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-245f7f18-7fa0-440d-8df5-12324c26733d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:16.389948 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-245f7f18-7fa0-440d-8df5-12324c26733d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.837096 Jun 16 16:13:16.390557 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 34/76] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:15 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:16.407278 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c8fdcc6c-f240-48cf-95c3-97744056e29a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:16.427301 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c8fdcc6c-f240-48cf-95c3-97744056e29a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1300 microversion: 2.1 time: 0.391698 Jun 16 16:13:16.427841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 43/77] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:16 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1300 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:16.570002 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-51b1e9bc-e446-4bcb-b023-59e7895dbb7a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:16.570693 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-51b1e9bc-e446-4bcb-b023-59e7895dbb7a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:16.583142 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-51b1e9bc-e446-4bcb-b023-59e7895dbb7a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:16.583823 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-51b1e9bc-e446-4bcb-b023-59e7895dbb7a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:16.584927 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-51b1e9bc-e446-4bcb-b023-59e7895dbb7a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:16.588883 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-51b1e9bc-e446-4bcb-b023-59e7895dbb7a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:16.995902 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d33caa5e-2119-429a-a4cf-7600aff98bf0 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:16.996852 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d33caa5e-2119-429a-a4cf-7600aff98bf0 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:17.003885 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d33caa5e-2119-429a-a4cf-7600aff98bf0 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:17.004897 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d33caa5e-2119-429a-a4cf-7600aff98bf0 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:17.005994 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d33caa5e-2119-429a-a4cf-7600aff98bf0 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:17.007094 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d33caa5e-2119-429a-a4cf-7600aff98bf0 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:17.048485 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=100 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:17.557327 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-51b1e9bc-e446-4bcb-b023-59e7895dbb7a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:17.585150 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-51b1e9bc-e446-4bcb-b023-59e7895dbb7a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:17.588109 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-51b1e9bc-e446-4bcb-b023-59e7895dbb7a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:17.590150 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-51b1e9bc-e446-4bcb-b023-59e7895dbb7a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 1.025291 Jun 16 16:13:17.599297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 35/78] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:16 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:17.616205 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d33caa5e-2119-429a-a4cf-7600aff98bf0 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:17.619932 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5bbdb625-772b-4954-957d-ec13eed100e4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:17.622164 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5bbdb625-772b-4954-957d-ec13eed100e4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:17.639657 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5bbdb625-772b-4954-957d-ec13eed100e4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:17.641522 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d33caa5e-2119-429a-a4cf-7600aff98bf0 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.649370 Jun 16 16:13:17.642289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5bbdb625-772b-4954-957d-ec13eed100e4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:17.643282 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5bbdb625-772b-4954-957d-ec13eed100e4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:17.647093 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 44/79] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:16 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:17.647999 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5bbdb625-772b-4954-957d-ec13eed100e4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:17.654010 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-674bb2c1-f386-4a71-8d11-1c5b13888bab tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:17.663863 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-674bb2c1-f386-4a71-8d11-1c5b13888bab tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:17.687715 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-674bb2c1-f386-4a71-8d11-1c5b13888bab tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:17.688491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-674bb2c1-f386-4a71-8d11-1c5b13888bab tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:17.689581 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-674bb2c1-f386-4a71-8d11-1c5b13888bab tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:17.701101 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-674bb2c1-f386-4a71-8d11-1c5b13888bab tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:17.843985 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-674bb2c1-f386-4a71-8d11-1c5b13888bab tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:17.853806 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-674bb2c1-f386-4a71-8d11-1c5b13888bab tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1300 microversion: 2.1 time: 0.204334 Jun 16 16:13:17.853806 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 45/80] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:17 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1300 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:17.988624 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-bcc6c6fb-0e4d-4e75-b041-df22f44b842d req-5958a771-27fa-477b-837d-e76ff739c8bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1", "name": "network-vif-plugged", "status": "completed", "tag": "52a71ee6-44fd-4a71-b587-86f364e02e17"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:18.015269 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-bcc6c6fb-0e4d-4e75-b041-df22f44b842d req-5958a771-27fa-477b-837d-e76ff739c8bd service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:18.015269 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-bcc6c6fb-0e4d-4e75-b041-df22f44b842d req-5958a771-27fa-477b-837d-e76ff739c8bd service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:18.038830 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-bcc6c6fb-0e4d-4e75-b041-df22f44b842d req-5958a771-27fa-477b-837d-e76ff739c8bd service nova] Creating event network-vif-plugged:52a71ee6-44fd-4a71-b587-86f364e02e17 for instance 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 on hv-cinder-83735 Jun 16 16:13:18.049374 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-bcc6c6fb-0e4d-4e75-b041-df22f44b842d req-5958a771-27fa-477b-837d-e76ff739c8bd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189679 Jun 16 16:13:18.051340 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 46/81] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:13:18.131095 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5bbdb625-772b-4954-957d-ec13eed100e4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:18.162410 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5bbdb625-772b-4954-957d-ec13eed100e4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.560613 Jun 16 16:13:18.178309 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 36/82] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:17 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:18.626564 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-76a77fdb-6872-4d82-a98d-20e0f635733a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:18.630693 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-76a77fdb-6872-4d82-a98d-20e0f635733a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:18.655818 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-76a77fdb-6872-4d82-a98d-20e0f635733a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:18.658243 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-76a77fdb-6872-4d82-a98d-20e0f635733a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:18.663516 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-76a77fdb-6872-4d82-a98d-20e0f635733a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:18.664089 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-76a77fdb-6872-4d82-a98d-20e0f635733a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:18.668421 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9815939f-c887-46dd-9c19-fbe181949a12 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:18.670592 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9815939f-c887-46dd-9c19-fbe181949a12 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:18.704830 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9815939f-c887-46dd-9c19-fbe181949a12 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:18.706569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9815939f-c887-46dd-9c19-fbe181949a12 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:18.712044 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9815939f-c887-46dd-9c19-fbe181949a12 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:18.713323 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9815939f-c887-46dd-9c19-fbe181949a12 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:19.025225 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-76a77fdb-6872-4d82-a98d-20e0f635733a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:19.035571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-76a77fdb-6872-4d82-a98d-20e0f635733a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:19.037233 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-76a77fdb-6872-4d82-a98d-20e0f635733a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:19.038402 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-76a77fdb-6872-4d82-a98d-20e0f635733a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.424702 Jun 16 16:13:19.039163 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 47/83] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:18 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:19.049647 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9815939f-c887-46dd-9c19-fbe181949a12 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:19.053827 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-49c62a43-2826-4952-a9b7-7c82c9ed9e44 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:19.055177 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-49c62a43-2826-4952-a9b7-7c82c9ed9e44 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:19.065083 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-49c62a43-2826-4952-a9b7-7c82c9ed9e44 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:19.068021 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9815939f-c887-46dd-9c19-fbe181949a12 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.407830 Jun 16 16:13:19.068865 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 37/84] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:18 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:19.069683 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-49c62a43-2826-4952-a9b7-7c82c9ed9e44 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:19.071534 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-49c62a43-2826-4952-a9b7-7c82c9ed9e44 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:19.071534 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-49c62a43-2826-4952-a9b7-7c82c9ed9e44 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:19.188407 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1802022a-b8a5-4b0b-9363-d615f803d6ee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:19.189402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1802022a-b8a5-4b0b-9363-d615f803d6ee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:19.197030 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1802022a-b8a5-4b0b-9363-d615f803d6ee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:19.199326 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1802022a-b8a5-4b0b-9363-d615f803d6ee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:19.200240 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1802022a-b8a5-4b0b-9363-d615f803d6ee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:19.200931 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1802022a-b8a5-4b0b-9363-d615f803d6ee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:19.265922 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-49c62a43-2826-4952-a9b7-7c82c9ed9e44 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:19.279962 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-49c62a43-2826-4952-a9b7-7c82c9ed9e44 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.231319 Jun 16 16:13:19.302256 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 48/85] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:19 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:19.517545 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1802022a-b8a5-4b0b-9363-d615f803d6ee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:19.538649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1802022a-b8a5-4b0b-9363-d615f803d6ee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.349917 Jun 16 16:13:19.542989 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 38/86] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:19 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:20.062510 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-74458d82-6595-48e1-aae0-dea253dc09c3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:20.069139 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-74458d82-6595-48e1-aae0-dea253dc09c3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:20.089755 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2cf1476c-2b39-4860-be42-01341395191a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:20.090570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2cf1476c-2b39-4860-be42-01341395191a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:20.106693 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2cf1476c-2b39-4860-be42-01341395191a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:20.107414 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2cf1476c-2b39-4860-be42-01341395191a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:20.108320 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2cf1476c-2b39-4860-be42-01341395191a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:20.108864 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2cf1476c-2b39-4860-be42-01341395191a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:20.121030 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-74458d82-6595-48e1-aae0-dea253dc09c3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:20.128157 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-74458d82-6595-48e1-aae0-dea253dc09c3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:20.129607 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-74458d82-6595-48e1-aae0-dea253dc09c3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:20.137904 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-74458d82-6595-48e1-aae0-dea253dc09c3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:21.058584 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-74458d82-6595-48e1-aae0-dea253dc09c3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:21.078769 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-74458d82-6595-48e1-aae0-dea253dc09c3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:21.084282 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-74458d82-6595-48e1-aae0-dea253dc09c3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:21.087407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-74458d82-6595-48e1-aae0-dea253dc09c3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 1.032319 Jun 16 16:13:21.097780 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 49/87] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:20 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:21.103502 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e63b7ce4-5de0-4fe1-acc5-16fdf6d3b244 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:21.118723 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e63b7ce4-5de0-4fe1-acc5-16fdf6d3b244 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:21.126561 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2cf1476c-2b39-4860-be42-01341395191a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:21.134282 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2cf1476c-2b39-4860-be42-01341395191a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 1.051428 Jun 16 16:13:21.144395 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 39/88] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:20 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:21.144528 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e63b7ce4-5de0-4fe1-acc5-16fdf6d3b244 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:21.144528 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e63b7ce4-5de0-4fe1-acc5-16fdf6d3b244 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:21.144528 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e63b7ce4-5de0-4fe1-acc5-16fdf6d3b244 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:21.144528 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e63b7ce4-5de0-4fe1-acc5-16fdf6d3b244 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:21.153038 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e5e21610-fd62-4916-a162-ed4c6eb8e19e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:21.153688 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e5e21610-fd62-4916-a162-ed4c6eb8e19e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:21.170160 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e5e21610-fd62-4916-a162-ed4c6eb8e19e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:21.174096 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e5e21610-fd62-4916-a162-ed4c6eb8e19e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:21.177656 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e5e21610-fd62-4916-a162-ed4c6eb8e19e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:21.180878 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e5e21610-fd62-4916-a162-ed4c6eb8e19e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:21.631476 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e63b7ce4-5de0-4fe1-acc5-16fdf6d3b244 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:21.642967 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e5e21610-fd62-4916-a162-ed4c6eb8e19e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:21.665943 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e63b7ce4-5de0-4fe1-acc5-16fdf6d3b244 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.565702 Jun 16 16:13:21.669817 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 50/89] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:21 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:21.671852 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e5e21610-fd62-4916-a162-ed4c6eb8e19e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.531202 Jun 16 16:13:21.709197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 40/90] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:21 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:21.964675 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-8e8a4787-b571-4000-ab1f-275af343c8cb req-f3e8abe0-d0c7-4cef-939f-e945a1ef82c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31998833-f554-4e9e-8215-6694a9d01970", "name": "network-vif-plugged", "status": "completed", "tag": "45b1ab78-929d-4b1a-90a1-4777fb503a47"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:21.984517 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-8e8a4787-b571-4000-ab1f-275af343c8cb req-f3e8abe0-d0c7-4cef-939f-e945a1ef82c4 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:21.987531 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-8e8a4787-b571-4000-ab1f-275af343c8cb req-f3e8abe0-d0c7-4cef-939f-e945a1ef82c4 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:22.032108 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-8e8a4787-b571-4000-ab1f-275af343c8cb req-f3e8abe0-d0c7-4cef-939f-e945a1ef82c4 service nova] Creating event network-vif-plugged:45b1ab78-929d-4b1a-90a1-4777fb503a47 for instance 31998833-f554-4e9e-8215-6694a9d01970 on hv-cinder-83735 Jun 16 16:13:22.046832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-8e8a4787-b571-4000-ab1f-275af343c8cb req-f3e8abe0-d0c7-4cef-939f-e945a1ef82c4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089664 Jun 16 16:13:22.053634 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 51/91] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:13:22.092207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-af456c20-239d-4d5d-b3a8-440d9139418b req-7419d562-06db-4387-b73a-0250f712f25f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6776a1f2-1043-4048-99e7-cdc91959fe40", "tag": "7a7bf458-a30a-41d7-a812-b5387bf22d99"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:22.101227 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-af456c20-239d-4d5d-b3a8-440d9139418b req-7419d562-06db-4387-b73a-0250f712f25f service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:22.101955 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-af456c20-239d-4d5d-b3a8-440d9139418b req-7419d562-06db-4387-b73a-0250f712f25f service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:22.110543 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-134e9a0a-0950-41e9-bf20-8fc4414d1cdf tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:22.111711 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-134e9a0a-0950-41e9-bf20-8fc4414d1cdf tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:22.115999 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-af456c20-239d-4d5d-b3a8-440d9139418b req-7419d562-06db-4387-b73a-0250f712f25f service nova] Creating event network-changed:7a7bf458-a30a-41d7-a812-b5387bf22d99 for instance 6776a1f2-1043-4048-99e7-cdc91959fe40 on hv-cinder-83735 Jun 16 16:13:22.122628 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-af456c20-239d-4d5d-b3a8-440d9139418b req-7419d562-06db-4387-b73a-0250f712f25f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034499 Jun 16 16:13:22.123542 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 41/92] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:13:22.160104 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c1e4e3e1-fc01-44fe-afb6-62c7e13194a9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:22.161232 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c1e4e3e1-fc01-44fe-afb6-62c7e13194a9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:22.161876 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-134e9a0a-0950-41e9-bf20-8fc4414d1cdf tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:22.163780 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-134e9a0a-0950-41e9-bf20-8fc4414d1cdf tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:22.165445 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-134e9a0a-0950-41e9-bf20-8fc4414d1cdf tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:22.166217 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-134e9a0a-0950-41e9-bf20-8fc4414d1cdf tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:22.168839 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c1e4e3e1-fc01-44fe-afb6-62c7e13194a9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:22.169286 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c1e4e3e1-fc01-44fe-afb6-62c7e13194a9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:22.170148 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c1e4e3e1-fc01-44fe-afb6-62c7e13194a9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:22.170535 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c1e4e3e1-fc01-44fe-afb6-62c7e13194a9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:22.467799 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c1e4e3e1-fc01-44fe-afb6-62c7e13194a9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:22.473225 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-134e9a0a-0950-41e9-bf20-8fc4414d1cdf tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:22.491125 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-134e9a0a-0950-41e9-bf20-8fc4414d1cdf tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:22.493411 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c1e4e3e1-fc01-44fe-afb6-62c7e13194a9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.342387 Jun 16 16:13:22.494052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 42/93] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:22 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:22.496071 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-134e9a0a-0950-41e9-bf20-8fc4414d1cdf tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:22.503828 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-134e9a0a-0950-41e9-bf20-8fc4414d1cdf tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.401049 Jun 16 16:13:22.504980 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 52/94] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:22 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:22.695240 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d2de1e2e-5caf-41ba-8c08-261571b7a556 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:22.696014 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d2de1e2e-5caf-41ba-8c08-261571b7a556 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:22.704407 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2de1e2e-5caf-41ba-8c08-261571b7a556 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:22.704859 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2de1e2e-5caf-41ba-8c08-261571b7a556 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:22.705636 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2de1e2e-5caf-41ba-8c08-261571b7a556 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:22.706114 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2de1e2e-5caf-41ba-8c08-261571b7a556 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:22.728543 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-20f497ba-aa56-4b85-bf16-f557c60a2487 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:22.731211 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-20f497ba-aa56-4b85-bf16-f557c60a2487 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:22.767227 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-20f497ba-aa56-4b85-bf16-f557c60a2487 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:22.770601 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-20f497ba-aa56-4b85-bf16-f557c60a2487 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:22.772884 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-20f497ba-aa56-4b85-bf16-f557c60a2487 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:22.775051 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-20f497ba-aa56-4b85-bf16-f557c60a2487 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:23.080116 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d2de1e2e-5caf-41ba-8c08-261571b7a556 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:23.083792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=100 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:23.089423 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d2de1e2e-5caf-41ba-8c08-261571b7a556 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.400099 Jun 16 16:13:23.090166 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 43/95] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:22 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:23.103977 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-20f497ba-aa56-4b85-bf16-f557c60a2487 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:23.112495 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-20f497ba-aa56-4b85-bf16-f557c60a2487 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.397715 Jun 16 16:13:23.113128 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 53/96] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:22 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:23.512310 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-66bad1ef-4a0f-4a03-98a9-cefd9c568da6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:23.512964 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-66bad1ef-4a0f-4a03-98a9-cefd9c568da6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:23.519627 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-66bad1ef-4a0f-4a03-98a9-cefd9c568da6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:23.520112 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-66bad1ef-4a0f-4a03-98a9-cefd9c568da6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:23.520888 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-66bad1ef-4a0f-4a03-98a9-cefd9c568da6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:23.521327 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-66bad1ef-4a0f-4a03-98a9-cefd9c568da6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:23.524569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c05cb1eb-5a83-48e1-a194-7099dd382649 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:23.525180 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c05cb1eb-5a83-48e1-a194-7099dd382649 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:23.532109 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c05cb1eb-5a83-48e1-a194-7099dd382649 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:23.532569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c05cb1eb-5a83-48e1-a194-7099dd382649 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:23.533347 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c05cb1eb-5a83-48e1-a194-7099dd382649 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:23.533820 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c05cb1eb-5a83-48e1-a194-7099dd382649 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:23.785810 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c05cb1eb-5a83-48e1-a194-7099dd382649 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:23.792114 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-66bad1ef-4a0f-4a03-98a9-cefd9c568da6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:23.803060 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c05cb1eb-5a83-48e1-a194-7099dd382649 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:23.804578 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-66bad1ef-4a0f-4a03-98a9-cefd9c568da6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.296845 Jun 16 16:13:23.805150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c05cb1eb-5a83-48e1-a194-7099dd382649 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:23.815555 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 44/97] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:23 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:23.816017 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c05cb1eb-5a83-48e1-a194-7099dd382649 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.286114 Jun 16 16:13:23.816017 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 54/98] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:23 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:13:24.107303 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7af5be9f-6e58-4656-8cbe-fd4e78997f86 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:24.107925 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7af5be9f-6e58-4656-8cbe-fd4e78997f86 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:24.114556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7af5be9f-6e58-4656-8cbe-fd4e78997f86 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:24.115004 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7af5be9f-6e58-4656-8cbe-fd4e78997f86 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:24.115776 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7af5be9f-6e58-4656-8cbe-fd4e78997f86 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:24.116216 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7af5be9f-6e58-4656-8cbe-fd4e78997f86 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:24.133362 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-989668ee-dd05-4b26-ae92-04a6207f7ffa tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:24.133362 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-989668ee-dd05-4b26-ae92-04a6207f7ffa tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:24.145511 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-989668ee-dd05-4b26-ae92-04a6207f7ffa tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:24.146388 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-989668ee-dd05-4b26-ae92-04a6207f7ffa tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:24.147622 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-989668ee-dd05-4b26-ae92-04a6207f7ffa tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:24.148694 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-989668ee-dd05-4b26-ae92-04a6207f7ffa tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:24.414669 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7af5be9f-6e58-4656-8cbe-fd4e78997f86 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:24.424742 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7af5be9f-6e58-4656-8cbe-fd4e78997f86 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.321493 Jun 16 16:13:24.425140 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-989668ee-dd05-4b26-ae92-04a6207f7ffa tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:24.428228 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 45/99] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:24 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:24.452754 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-989668ee-dd05-4b26-ae92-04a6207f7ffa tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.325876 Jun 16 16:13:24.453781 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 55/100] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:24 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:24.825895 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f8ec9b2b-16f1-4719-8975-4f7f88955a4e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:24.825895 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f8ec9b2b-16f1-4719-8975-4f7f88955a4e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:24.831864 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f8ec9b2b-16f1-4719-8975-4f7f88955a4e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:24.832387 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f8ec9b2b-16f1-4719-8975-4f7f88955a4e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:24.833171 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f8ec9b2b-16f1-4719-8975-4f7f88955a4e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:24.833616 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f8ec9b2b-16f1-4719-8975-4f7f88955a4e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:24.835772 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9d7dfd0d-df83-4ec2-bbc7-26922a40e679 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:24.836627 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9d7dfd0d-df83-4ec2-bbc7-26922a40e679 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:24.844632 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d7dfd0d-df83-4ec2-bbc7-26922a40e679 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:24.845343 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d7dfd0d-df83-4ec2-bbc7-26922a40e679 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:24.846617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d7dfd0d-df83-4ec2-bbc7-26922a40e679 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:24.847153 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d7dfd0d-df83-4ec2-bbc7-26922a40e679 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:25.036997 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f8ec9b2b-16f1-4719-8975-4f7f88955a4e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:25.054271 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f8ec9b2b-16f1-4719-8975-4f7f88955a4e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.235156 Jun 16 16:13:25.054872 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 46/101] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:24 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:25.078599 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9d7dfd0d-df83-4ec2-bbc7-26922a40e679 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:25.091708 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9d7dfd0d-df83-4ec2-bbc7-26922a40e679 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:25.093559 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9d7dfd0d-df83-4ec2-bbc7-26922a40e679 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:25.095615 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9d7dfd0d-df83-4ec2-bbc7-26922a40e679 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.265082 Jun 16 16:13:25.096932 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 56/102] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:24 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:25.451706 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e46620ce-bb66-449c-868a-0802855fb191 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:25.452667 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e46620ce-bb66-449c-868a-0802855fb191 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:25.462349 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e46620ce-bb66-449c-868a-0802855fb191 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:25.463028 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e46620ce-bb66-449c-868a-0802855fb191 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:25.464236 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e46620ce-bb66-449c-868a-0802855fb191 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:25.464903 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e46620ce-bb66-449c-868a-0802855fb191 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:25.472038 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c92fb832-042a-4d36-89c9-3f964be63160 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:25.472726 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c92fb832-042a-4d36-89c9-3f964be63160 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:25.479516 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c92fb832-042a-4d36-89c9-3f964be63160 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:25.480480 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c92fb832-042a-4d36-89c9-3f964be63160 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:25.481460 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c92fb832-042a-4d36-89c9-3f964be63160 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:25.481944 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c92fb832-042a-4d36-89c9-3f964be63160 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:25.745106 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c92fb832-042a-4d36-89c9-3f964be63160 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:25.749868 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e46620ce-bb66-449c-868a-0802855fb191 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:25.764259 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c92fb832-042a-4d36-89c9-3f964be63160 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.297082 Jun 16 16:13:25.764950 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 57/103] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:25 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:25.767246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e46620ce-bb66-449c-868a-0802855fb191 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.321936 Jun 16 16:13:25.767849 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 47/104] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:25 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:26.071980 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7a466b7c-ab07-4605-8c52-085fbeaf002b tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:26.072589 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7a466b7c-ab07-4605-8c52-085fbeaf002b tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:26.084379 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7a466b7c-ab07-4605-8c52-085fbeaf002b tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:26.084834 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7a466b7c-ab07-4605-8c52-085fbeaf002b tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:26.085627 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7a466b7c-ab07-4605-8c52-085fbeaf002b tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:26.086100 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7a466b7c-ab07-4605-8c52-085fbeaf002b tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:26.114959 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cc2c467d-042e-4768-ad8f-76e4908ac696 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:26.115633 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-cc2c467d-042e-4768-ad8f-76e4908ac696 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:26.122807 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cc2c467d-042e-4768-ad8f-76e4908ac696 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:26.123450 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cc2c467d-042e-4768-ad8f-76e4908ac696 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:26.124065 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cc2c467d-042e-4768-ad8f-76e4908ac696 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:26.124500 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cc2c467d-042e-4768-ad8f-76e4908ac696 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:26.281304 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7a466b7c-ab07-4605-8c52-085fbeaf002b tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:26.293518 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7a466b7c-ab07-4605-8c52-085fbeaf002b tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.225393 Jun 16 16:13:26.294176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 58/105] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:26 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:26.330310 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cc2c467d-042e-4768-ad8f-76e4908ac696 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:26.339045 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cc2c467d-042e-4768-ad8f-76e4908ac696 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:26.341081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cc2c467d-042e-4768-ad8f-76e4908ac696 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:26.342249 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-cc2c467d-042e-4768-ad8f-76e4908ac696 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.231249 Jun 16 16:13:26.342819 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 48/106] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:26 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:13:26.782618 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6b9be233-29c6-407f-afe2-552d47e11297 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:26.783243 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6b9be233-29c6-407f-afe2-552d47e11297 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:26.789598 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6b9be233-29c6-407f-afe2-552d47e11297 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:26.790088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6b9be233-29c6-407f-afe2-552d47e11297 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:26.790867 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6b9be233-29c6-407f-afe2-552d47e11297 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:26.791306 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6b9be233-29c6-407f-afe2-552d47e11297 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:26.791454 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f3494847-6bf7-40d3-92be-85414d1b8afc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:26.792080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f3494847-6bf7-40d3-92be-85414d1b8afc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:26.799273 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f3494847-6bf7-40d3-92be-85414d1b8afc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:26.799719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f3494847-6bf7-40d3-92be-85414d1b8afc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:26.800477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f3494847-6bf7-40d3-92be-85414d1b8afc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:26.800908 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f3494847-6bf7-40d3-92be-85414d1b8afc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:27.014366 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6b9be233-29c6-407f-afe2-552d47e11297 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:27.018925 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f3494847-6bf7-40d3-92be-85414d1b8afc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:27.028153 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6b9be233-29c6-407f-afe2-552d47e11297 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.249154 Jun 16 16:13:27.030792 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 59/107] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:26 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:27.034871 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f3494847-6bf7-40d3-92be-85414d1b8afc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.247404 Jun 16 16:13:27.035773 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 49/108] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:26 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:27.311560 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-92041cc0-bd70-4dfe-906e-bc059c7a9d04 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:27.312190 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-92041cc0-bd70-4dfe-906e-bc059c7a9d04 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:27.318203 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-92041cc0-bd70-4dfe-906e-bc059c7a9d04 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:27.318644 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-92041cc0-bd70-4dfe-906e-bc059c7a9d04 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:27.319493 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-92041cc0-bd70-4dfe-906e-bc059c7a9d04 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:27.319916 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-92041cc0-bd70-4dfe-906e-bc059c7a9d04 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:27.360317 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9266948e-334d-4a1e-bb78-c1ed6f80d1ab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:27.360915 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9266948e-334d-4a1e-bb78-c1ed6f80d1ab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:27.370866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9266948e-334d-4a1e-bb78-c1ed6f80d1ab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:27.371642 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9266948e-334d-4a1e-bb78-c1ed6f80d1ab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:27.372983 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9266948e-334d-4a1e-bb78-c1ed6f80d1ab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:27.373788 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9266948e-334d-4a1e-bb78-c1ed6f80d1ab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:27.502363 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-92041cc0-bd70-4dfe-906e-bc059c7a9d04 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:27.510226 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-92041cc0-bd70-4dfe-906e-bc059c7a9d04 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.202952 Jun 16 16:13:27.510820 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 60/109] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:27 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:27.550221 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9266948e-334d-4a1e-bb78-c1ed6f80d1ab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:27.558279 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9266948e-334d-4a1e-bb78-c1ed6f80d1ab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:27.559756 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9266948e-334d-4a1e-bb78-c1ed6f80d1ab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:27.561441 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9266948e-334d-4a1e-bb78-c1ed6f80d1ab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.204489 Jun 16 16:13:27.562117 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 50/110] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:27 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:13:28.049887 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d3fa5a5b-1b75-4f57-955c-9969e75ec42c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:28.050681 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d3fa5a5b-1b75-4f57-955c-9969e75ec42c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:28.053785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-40539dad-c15c-47be-af41-b0b640aa9788 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:28.054403 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-40539dad-c15c-47be-af41-b0b640aa9788 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:28.057094 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d3fa5a5b-1b75-4f57-955c-9969e75ec42c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:28.057555 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d3fa5a5b-1b75-4f57-955c-9969e75ec42c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:28.058499 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d3fa5a5b-1b75-4f57-955c-9969e75ec42c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:28.058933 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d3fa5a5b-1b75-4f57-955c-9969e75ec42c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:28.060699 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-40539dad-c15c-47be-af41-b0b640aa9788 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:28.061152 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-40539dad-c15c-47be-af41-b0b640aa9788 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:28.061961 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-40539dad-c15c-47be-af41-b0b640aa9788 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:28.062394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-40539dad-c15c-47be-af41-b0b640aa9788 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:28.452407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d3fa5a5b-1b75-4f57-955c-9969e75ec42c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:28.454781 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-40539dad-c15c-47be-af41-b0b640aa9788 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:28.460271 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d3fa5a5b-1b75-4f57-955c-9969e75ec42c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.414300 Jun 16 16:13:28.460863 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 61/111] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:28 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:28.462395 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-40539dad-c15c-47be-af41-b0b640aa9788 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.412963 Jun 16 16:13:28.462976 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 51/112] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:28 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:28.528007 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4d0282cc-e2d3-4076-ad4d-dbd394855ec8 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:28.528615 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4d0282cc-e2d3-4076-ad4d-dbd394855ec8 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:28.534923 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4d0282cc-e2d3-4076-ad4d-dbd394855ec8 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:28.535368 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4d0282cc-e2d3-4076-ad4d-dbd394855ec8 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:28.536133 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4d0282cc-e2d3-4076-ad4d-dbd394855ec8 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:28.536567 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4d0282cc-e2d3-4076-ad4d-dbd394855ec8 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:28.556752 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=100 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:28.580208 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4f7f172a-0f7b-41b5-827c-0b1fc4fceac5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:28.580870 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4f7f172a-0f7b-41b5-827c-0b1fc4fceac5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:28.587485 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4f7f172a-0f7b-41b5-827c-0b1fc4fceac5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:28.587934 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4f7f172a-0f7b-41b5-827c-0b1fc4fceac5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:28.588709 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4f7f172a-0f7b-41b5-827c-0b1fc4fceac5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:28.589809 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4f7f172a-0f7b-41b5-827c-0b1fc4fceac5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:28.720366 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4d0282cc-e2d3-4076-ad4d-dbd394855ec8 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:28.735663 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4d0282cc-e2d3-4076-ad4d-dbd394855ec8 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.208812 Jun 16 16:13:28.735663 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 62/113] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:28 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:28.762986 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4f7f172a-0f7b-41b5-827c-0b1fc4fceac5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:28.775867 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4f7f172a-0f7b-41b5-827c-0b1fc4fceac5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:28.777987 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4f7f172a-0f7b-41b5-827c-0b1fc4fceac5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:28.779995 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4f7f172a-0f7b-41b5-827c-0b1fc4fceac5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.203600 Jun 16 16:13:28.781008 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 52/114] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:28 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:13:29.478428 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7485bf5e-3180-47db-8f93-07bcb5eb3f5c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:29.479234 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7485bf5e-3180-47db-8f93-07bcb5eb3f5c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:29.480269 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7ffd3b71-b7ba-44f2-8333-758f90712395 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:29.480923 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7ffd3b71-b7ba-44f2-8333-758f90712395 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:29.485522 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7485bf5e-3180-47db-8f93-07bcb5eb3f5c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:29.486014 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7485bf5e-3180-47db-8f93-07bcb5eb3f5c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:29.486777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7485bf5e-3180-47db-8f93-07bcb5eb3f5c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:29.487045 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7ffd3b71-b7ba-44f2-8333-758f90712395 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:29.487205 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7485bf5e-3180-47db-8f93-07bcb5eb3f5c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:29.487499 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7ffd3b71-b7ba-44f2-8333-758f90712395 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:29.488270 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7ffd3b71-b7ba-44f2-8333-758f90712395 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:29.488716 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7ffd3b71-b7ba-44f2-8333-758f90712395 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:29.690541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7485bf5e-3180-47db-8f93-07bcb5eb3f5c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:29.694500 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7ffd3b71-b7ba-44f2-8333-758f90712395 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:29.698767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7485bf5e-3180-47db-8f93-07bcb5eb3f5c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.224391 Jun 16 16:13:29.699363 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 63/115] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:29 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:29.701982 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7ffd3b71-b7ba-44f2-8333-758f90712395 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.225516 Jun 16 16:13:29.702697 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 53/116] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:29 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:29.750786 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-86c6cfe3-c613-48f8-bbb3-7596a03e0ca7 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:29.751399 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-86c6cfe3-c613-48f8-bbb3-7596a03e0ca7 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:29.757555 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-86c6cfe3-c613-48f8-bbb3-7596a03e0ca7 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:29.758030 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-86c6cfe3-c613-48f8-bbb3-7596a03e0ca7 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:29.758806 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-86c6cfe3-c613-48f8-bbb3-7596a03e0ca7 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:29.759311 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-86c6cfe3-c613-48f8-bbb3-7596a03e0ca7 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:29.806459 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ba653f7c-7284-4e1e-a5c8-e03360b572fb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:29.807177 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ba653f7c-7284-4e1e-a5c8-e03360b572fb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:29.813646 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ba653f7c-7284-4e1e-a5c8-e03360b572fb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:29.814126 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ba653f7c-7284-4e1e-a5c8-e03360b572fb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:29.814886 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ba653f7c-7284-4e1e-a5c8-e03360b572fb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:29.815326 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ba653f7c-7284-4e1e-a5c8-e03360b572fb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:29.951458 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-86c6cfe3-c613-48f8-bbb3-7596a03e0ca7 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:29.952613 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-86c6cfe3-c613-48f8-bbb3-7596a03e0ca7 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.205311 Jun 16 16:13:29.953682 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 64/117] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:29 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:30.002394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ba653f7c-7284-4e1e-a5c8-e03360b572fb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:30.010977 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ba653f7c-7284-4e1e-a5c8-e03360b572fb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:30.012583 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ba653f7c-7284-4e1e-a5c8-e03360b572fb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:30.013699 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ba653f7c-7284-4e1e-a5c8-e03360b572fb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.211342 Jun 16 16:13:30.014361 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 54/118] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:29 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:13:30.716705 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-de9ff7ed-728b-4045-9900-c558483528bc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:30.717512 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-de9ff7ed-728b-4045-9900-c558483528bc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:30.721684 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d21fb63a-aa48-4386-a77d-4baa1ddf6d5d tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:30.722348 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d21fb63a-aa48-4386-a77d-4baa1ddf6d5d tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:30.723949 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-de9ff7ed-728b-4045-9900-c558483528bc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:30.724400 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-de9ff7ed-728b-4045-9900-c558483528bc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:30.725166 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-de9ff7ed-728b-4045-9900-c558483528bc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:30.725604 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-de9ff7ed-728b-4045-9900-c558483528bc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:30.728467 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d21fb63a-aa48-4386-a77d-4baa1ddf6d5d tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:30.728908 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d21fb63a-aa48-4386-a77d-4baa1ddf6d5d tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:30.730116 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d21fb63a-aa48-4386-a77d-4baa1ddf6d5d tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:30.730823 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d21fb63a-aa48-4386-a77d-4baa1ddf6d5d tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:30.945128 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d21fb63a-aa48-4386-a77d-4baa1ddf6d5d tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:30.950682 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-de9ff7ed-728b-4045-9900-c558483528bc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:30.956181 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d21fb63a-aa48-4386-a77d-4baa1ddf6d5d tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.240321 Jun 16 16:13:30.960101 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-de9ff7ed-728b-4045-9900-c558483528bc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.248202 Jun 16 16:13:30.960922 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 65/119] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:30 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:30.970561 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 55/120] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:30 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:30.975472 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-939b53d0-e00e-4fea-954f-3d5969b740ce tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:30.976085 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-939b53d0-e00e-4fea-954f-3d5969b740ce tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:30.984225 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-939b53d0-e00e-4fea-954f-3d5969b740ce tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:30.985182 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-939b53d0-e00e-4fea-954f-3d5969b740ce tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:30.985742 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-939b53d0-e00e-4fea-954f-3d5969b740ce tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:30.986190 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-939b53d0-e00e-4fea-954f-3d5969b740ce tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:31.039172 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5642fe52-26ae-40a3-ac44-b0ca6bf4ef75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:31.040179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5642fe52-26ae-40a3-ac44-b0ca6bf4ef75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:31.050326 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5642fe52-26ae-40a3-ac44-b0ca6bf4ef75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:31.051106 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5642fe52-26ae-40a3-ac44-b0ca6bf4ef75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:31.052642 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5642fe52-26ae-40a3-ac44-b0ca6bf4ef75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:31.053761 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5642fe52-26ae-40a3-ac44-b0ca6bf4ef75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:31.212304 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-939b53d0-e00e-4fea-954f-3d5969b740ce tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:31.220911 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-939b53d0-e00e-4fea-954f-3d5969b740ce tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.249832 Jun 16 16:13:31.221946 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 56/121] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:30 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:31.258409 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5642fe52-26ae-40a3-ac44-b0ca6bf4ef75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:31.270063 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5642fe52-26ae-40a3-ac44-b0ca6bf4ef75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:31.271616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5642fe52-26ae-40a3-ac44-b0ca6bf4ef75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:31.272989 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5642fe52-26ae-40a3-ac44-b0ca6bf4ef75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.245243 Jun 16 16:13:31.273552 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 66/122] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:31 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:31.510256 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-b60f3a86-2331-4da2-85e0-fcd7a2bcf2bc req-8d588945-b4bf-42df-9f19-526ca249d1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c1389bc-ae98-44d1-943a-669b44dde9ad", "name": "network-vif-plugged", "status": "completed", "tag": "9fc73dbb-a75c-415a-b8f8-fbf849262a05"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:31.520061 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-b60f3a86-2331-4da2-85e0-fcd7a2bcf2bc req-8d588945-b4bf-42df-9f19-526ca249d1a3 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:31.520718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-b60f3a86-2331-4da2-85e0-fcd7a2bcf2bc req-8d588945-b4bf-42df-9f19-526ca249d1a3 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:31.536417 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-b60f3a86-2331-4da2-85e0-fcd7a2bcf2bc req-8d588945-b4bf-42df-9f19-526ca249d1a3 service nova] Creating event network-vif-plugged:9fc73dbb-a75c-415a-b8f8-fbf849262a05 for instance 7c1389bc-ae98-44d1-943a-669b44dde9ad on hv-cinder-83735 Jun 16 16:13:31.543296 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-b60f3a86-2331-4da2-85e0-fcd7a2bcf2bc req-8d588945-b4bf-42df-9f19-526ca249d1a3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036577 Jun 16 16:13:31.544363 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 57/123] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:13:31.974655 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-11987555-fb4c-4eb3-8eba-ddfd24459e5f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:31.975392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-11987555-fb4c-4eb3-8eba-ddfd24459e5f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:31.980519 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4f56df87-c243-4f28-b394-10cf027e87f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:31.981845 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4f56df87-c243-4f28-b394-10cf027e87f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:31.984478 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-11987555-fb4c-4eb3-8eba-ddfd24459e5f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:31.985015 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-11987555-fb4c-4eb3-8eba-ddfd24459e5f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:31.985833 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-11987555-fb4c-4eb3-8eba-ddfd24459e5f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:31.986275 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-11987555-fb4c-4eb3-8eba-ddfd24459e5f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:31.990075 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4f56df87-c243-4f28-b394-10cf027e87f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:31.990476 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4f56df87-c243-4f28-b394-10cf027e87f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:31.991405 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4f56df87-c243-4f28-b394-10cf027e87f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:31.991841 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4f56df87-c243-4f28-b394-10cf027e87f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:32.194127 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-11987555-fb4c-4eb3-8eba-ddfd24459e5f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:32.201208 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4f56df87-c243-4f28-b394-10cf027e87f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:32.206520 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-11987555-fb4c-4eb3-8eba-ddfd24459e5f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.235508 Jun 16 16:13:32.207434 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 67/124] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:31 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:32.209810 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4f56df87-c243-4f28-b394-10cf027e87f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.233953 Jun 16 16:13:32.210377 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 58/125] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:31 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:32.240216 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-39d50d90-ec72-48d4-ab5a-9c517c7bceed tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:32.240829 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-39d50d90-ec72-48d4-ab5a-9c517c7bceed tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:32.247529 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-39d50d90-ec72-48d4-ab5a-9c517c7bceed tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:32.247988 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-39d50d90-ec72-48d4-ab5a-9c517c7bceed tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:32.248764 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-39d50d90-ec72-48d4-ab5a-9c517c7bceed tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:32.249197 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-39d50d90-ec72-48d4-ab5a-9c517c7bceed tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:32.300928 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0b750276-5278-4f4c-be3e-36d2e2ca606a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:32.301890 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0b750276-5278-4f4c-be3e-36d2e2ca606a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:32.313383 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0b750276-5278-4f4c-be3e-36d2e2ca606a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:32.315941 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0b750276-5278-4f4c-be3e-36d2e2ca606a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:32.315941 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0b750276-5278-4f4c-be3e-36d2e2ca606a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:32.315941 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0b750276-5278-4f4c-be3e-36d2e2ca606a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:32.510455 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-39d50d90-ec72-48d4-ab5a-9c517c7bceed tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:32.518477 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-39d50d90-ec72-48d4-ab5a-9c517c7bceed tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.282501 Jun 16 16:13:32.519069 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 68/126] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:32 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:32.595947 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0b750276-5278-4f4c-be3e-36d2e2ca606a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:32.606066 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0b750276-5278-4f4c-be3e-36d2e2ca606a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:32.607604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0b750276-5278-4f4c-be3e-36d2e2ca606a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:32.608727 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0b750276-5278-4f4c-be3e-36d2e2ca606a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.311877 Jun 16 16:13:32.618924 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 59/127] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:32 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:13:33.228368 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-27efac3f-0cb4-45f0-96df-a614010dfa23 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:33.229469 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-27efac3f-0cb4-45f0-96df-a614010dfa23 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:33.233953 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2ac1da8a-1ecb-4dbe-873e-38c60766569e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:33.234991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2ac1da8a-1ecb-4dbe-873e-38c60766569e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:33.240697 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-27efac3f-0cb4-45f0-96df-a614010dfa23 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:33.241419 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-27efac3f-0cb4-45f0-96df-a614010dfa23 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:33.242422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2ac1da8a-1ecb-4dbe-873e-38c60766569e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:33.242947 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2ac1da8a-1ecb-4dbe-873e-38c60766569e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:33.243194 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-27efac3f-0cb4-45f0-96df-a614010dfa23 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:33.243828 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-27efac3f-0cb4-45f0-96df-a614010dfa23 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:33.244880 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2ac1da8a-1ecb-4dbe-873e-38c60766569e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:33.245949 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2ac1da8a-1ecb-4dbe-873e-38c60766569e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:33.475617 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2ac1da8a-1ecb-4dbe-873e-38c60766569e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:33.477690 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-27efac3f-0cb4-45f0-96df-a614010dfa23 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:33.486784 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-27efac3f-0cb4-45f0-96df-a614010dfa23 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.265821 Jun 16 16:13:33.487608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 69/128] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:33 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:33.489578 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2ac1da8a-1ecb-4dbe-873e-38c60766569e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.260691 Jun 16 16:13:33.490283 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 60/129] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:33 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:33.539263 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0bd24c0b-12d1-4c75-931a-ac86e19fac84 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:33.539934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0bd24c0b-12d1-4c75-931a-ac86e19fac84 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:33.547033 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0bd24c0b-12d1-4c75-931a-ac86e19fac84 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:33.547482 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0bd24c0b-12d1-4c75-931a-ac86e19fac84 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:33.548243 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0bd24c0b-12d1-4c75-931a-ac86e19fac84 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:33.548672 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0bd24c0b-12d1-4c75-931a-ac86e19fac84 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:33.629635 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-63289002-a480-49a8-9010-ba6a3b042dc9 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:33.630594 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-63289002-a480-49a8-9010-ba6a3b042dc9 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:33.645113 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-63289002-a480-49a8-9010-ba6a3b042dc9 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:33.646047 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-63289002-a480-49a8-9010-ba6a3b042dc9 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:33.647222 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-63289002-a480-49a8-9010-ba6a3b042dc9 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:33.652531 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-63289002-a480-49a8-9010-ba6a3b042dc9 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:33.660817 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=100 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:33.717595 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0bd24c0b-12d1-4c75-931a-ac86e19fac84 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:33.741194 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0bd24c0b-12d1-4c75-931a-ac86e19fac84 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.205194 Jun 16 16:13:33.742411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 70/130] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:33 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:33.850266 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-63289002-a480-49a8-9010-ba6a3b042dc9 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:33.860790 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-63289002-a480-49a8-9010-ba6a3b042dc9 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:33.862508 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-63289002-a480-49a8-9010-ba6a3b042dc9 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:33.863879 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-63289002-a480-49a8-9010-ba6a3b042dc9 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.239227 Jun 16 16:13:33.874862 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 61/131] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:33 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:13:34.505010 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1da378b5-5172-42ac-9db2-0954b0980984 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:34.505617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1da378b5-5172-42ac-9db2-0954b0980984 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:34.507685 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-381e0dc2-c271-4494-9ce8-80fdc25c1c8c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:34.508954 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-381e0dc2-c271-4494-9ce8-80fdc25c1c8c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:34.515522 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1da378b5-5172-42ac-9db2-0954b0980984 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:34.515522 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1da378b5-5172-42ac-9db2-0954b0980984 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:34.515522 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1da378b5-5172-42ac-9db2-0954b0980984 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:34.515522 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1da378b5-5172-42ac-9db2-0954b0980984 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:34.522120 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-381e0dc2-c271-4494-9ce8-80fdc25c1c8c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:34.522677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-381e0dc2-c271-4494-9ce8-80fdc25c1c8c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:34.523518 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-381e0dc2-c271-4494-9ce8-80fdc25c1c8c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:34.524188 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-381e0dc2-c271-4494-9ce8-80fdc25c1c8c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:34.794467 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1da378b5-5172-42ac-9db2-0954b0980984 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:34.797553 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-381e0dc2-c271-4494-9ce8-80fdc25c1c8c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:34.805264 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-381e0dc2-c271-4494-9ce8-80fdc25c1c8c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.301628 Jun 16 16:13:34.810296 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 62/132] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:34 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:34.810475 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1da378b5-5172-42ac-9db2-0954b0980984 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.305038 Jun 16 16:13:34.810475 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 71/133] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:34 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:34.811706 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-eb19cffa-1dbb-46e0-be83-11ee921f990c tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:34.812324 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-eb19cffa-1dbb-46e0-be83-11ee921f990c tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:34.818691 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-eb19cffa-1dbb-46e0-be83-11ee921f990c tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:34.819369 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-eb19cffa-1dbb-46e0-be83-11ee921f990c tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:34.819905 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-eb19cffa-1dbb-46e0-be83-11ee921f990c tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:34.820377 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-eb19cffa-1dbb-46e0-be83-11ee921f990c tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:34.884210 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-22149248-75b9-4fde-9fe3-437a32809d49 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:34.885061 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-22149248-75b9-4fde-9fe3-437a32809d49 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:34.892680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-22149248-75b9-4fde-9fe3-437a32809d49 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:34.893250 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-22149248-75b9-4fde-9fe3-437a32809d49 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:34.894668 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-22149248-75b9-4fde-9fe3-437a32809d49 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:34.895478 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-22149248-75b9-4fde-9fe3-437a32809d49 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:35.026733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-eb19cffa-1dbb-46e0-be83-11ee921f990c tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:35.035500 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-eb19cffa-1dbb-46e0-be83-11ee921f990c tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.228128 Jun 16 16:13:35.036086 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 63/134] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:34 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:35.098874 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-22149248-75b9-4fde-9fe3-437a32809d49 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:35.109248 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-22149248-75b9-4fde-9fe3-437a32809d49 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:35.110925 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-22149248-75b9-4fde-9fe3-437a32809d49 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:35.112054 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-22149248-75b9-4fde-9fe3-437a32809d49 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.233464 Jun 16 16:13:35.112632 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 72/135] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:34 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:35.825401 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8d0467c5-85d6-40e8-a37f-3620e0fae305 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:35.826041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-98b46991-453a-4eb3-a089-a47e669869ee tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:35.826383 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-98b46991-453a-4eb3-a089-a47e669869ee tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:35.827333 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8d0467c5-85d6-40e8-a37f-3620e0fae305 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:35.832340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-98b46991-453a-4eb3-a089-a47e669869ee tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:35.833498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-98b46991-453a-4eb3-a089-a47e669869ee tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:35.835077 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-98b46991-453a-4eb3-a089-a47e669869ee tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:35.835955 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-98b46991-453a-4eb3-a089-a47e669869ee tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:35.840082 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8d0467c5-85d6-40e8-a37f-3620e0fae305 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:35.840913 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8d0467c5-85d6-40e8-a37f-3620e0fae305 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:35.842143 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8d0467c5-85d6-40e8-a37f-3620e0fae305 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:35.842775 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8d0467c5-85d6-40e8-a37f-3620e0fae305 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:36.074221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8d0467c5-85d6-40e8-a37f-3620e0fae305 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:36.088330 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8d0467c5-85d6-40e8-a37f-3620e0fae305 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1322 microversion: 2.1 time: 0.267608 Jun 16 16:13:36.089038 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 73/136] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:35 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:36.093685 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8f9e223a-3b34-4a24-9358-0b98f9ebc703 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:36.100588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8f9e223a-3b34-4a24-9358-0b98f9ebc703 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:36.121820 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8f9e223a-3b34-4a24-9358-0b98f9ebc703 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:36.122817 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8f9e223a-3b34-4a24-9358-0b98f9ebc703 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:36.124107 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8f9e223a-3b34-4a24-9358-0b98f9ebc703 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:36.124880 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8f9e223a-3b34-4a24-9358-0b98f9ebc703 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:36.229632 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-98b46991-453a-4eb3-a089-a47e669869ee tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:36.242374 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-98b46991-453a-4eb3-a089-a47e669869ee tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.421744 Jun 16 16:13:36.243577 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 64/137] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:35 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:36.253987 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ea4f3d93-1a41-4640-9818-df4a86595f67 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:36.254844 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ea4f3d93-1a41-4640-9818-df4a86595f67 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:36.264007 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ea4f3d93-1a41-4640-9818-df4a86595f67 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:36.265431 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ea4f3d93-1a41-4640-9818-df4a86595f67 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:36.266729 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ea4f3d93-1a41-4640-9818-df4a86595f67 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:36.267516 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ea4f3d93-1a41-4640-9818-df4a86595f67 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:36.469292 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8f9e223a-3b34-4a24-9358-0b98f9ebc703 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:36.482106 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8f9e223a-3b34-4a24-9358-0b98f9ebc703 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.391600 Jun 16 16:13:36.483175 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 74/138] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:36 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:36.522055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ea4f3d93-1a41-4640-9818-df4a86595f67 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:36.532860 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ea4f3d93-1a41-4640-9818-df4a86595f67 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:36.534611 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ea4f3d93-1a41-4640-9818-df4a86595f67 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:36.535771 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ea4f3d93-1a41-4640-9818-df4a86595f67 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.290866 Jun 16 16:13:36.536965 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 65/139] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:36 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:37.105496 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2f9455e8-d654-446f-99c3-f718cf74fcb0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:37.107249 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2f9455e8-d654-446f-99c3-f718cf74fcb0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:37.117590 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=91 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:37.126032 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2f9455e8-d654-446f-99c3-f718cf74fcb0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:37.128874 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2f9455e8-d654-446f-99c3-f718cf74fcb0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:37.130960 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2f9455e8-d654-446f-99c3-f718cf74fcb0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:37.131585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2f9455e8-d654-446f-99c3-f718cf74fcb0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:37.270971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cb32d25b-e526-463b-9222-a8d47b50c844 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:37.271974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-cb32d25b-e526-463b-9222-a8d47b50c844 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:37.279268 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=83 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:37.291583 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cb32d25b-e526-463b-9222-a8d47b50c844 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:37.294448 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cb32d25b-e526-463b-9222-a8d47b50c844 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:37.297300 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cb32d25b-e526-463b-9222-a8d47b50c844 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:37.299123 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cb32d25b-e526-463b-9222-a8d47b50c844 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:37.883265 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2f9455e8-d654-446f-99c3-f718cf74fcb0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:37.893952 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cb32d25b-e526-463b-9222-a8d47b50c844 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:37.902051 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-cb32d25b-e526-463b-9222-a8d47b50c844 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.636746 Jun 16 16:13:37.902801 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 66/140] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:37 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:37.907688 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a8d4a5ef-ba17-47b4-9c9c-cac2d4c7cbac tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:37.908645 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a8d4a5ef-ba17-47b4-9c9c-cac2d4c7cbac tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:37.910775 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2f9455e8-d654-446f-99c3-f718cf74fcb0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1516 microversion: 2.1 time: 0.809329 Jun 16 16:13:37.911742 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 75/141] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:37 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1516 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:37.919241 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b4c0e67c-5473-466a-9422-150ee91352d8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:37.920171 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b4c0e67c-5473-466a-9422-150ee91352d8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:37.927006 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a8d4a5ef-ba17-47b4-9c9c-cac2d4c7cbac tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:37.927444 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a8d4a5ef-ba17-47b4-9c9c-cac2d4c7cbac tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:37.928414 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a8d4a5ef-ba17-47b4-9c9c-cac2d4c7cbac tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:37.928584 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b4c0e67c-5473-466a-9422-150ee91352d8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:37.928842 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a8d4a5ef-ba17-47b4-9c9c-cac2d4c7cbac tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:37.929265 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b4c0e67c-5473-466a-9422-150ee91352d8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:37.930433 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b4c0e67c-5473-466a-9422-150ee91352d8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:37.931164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b4c0e67c-5473-466a-9422-150ee91352d8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:38.154694 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a8d4a5ef-ba17-47b4-9c9c-cac2d4c7cbac tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:38.165866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a8d4a5ef-ba17-47b4-9c9c-cac2d4c7cbac tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.258230 Jun 16 16:13:38.165866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 67/142] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:37 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:38.166043 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b4c0e67c-5473-466a-9422-150ee91352d8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:38.168618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-30d833cd-e38a-41d5-bb24-59e88b4401a9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:38.169922 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-30d833cd-e38a-41d5-bb24-59e88b4401a9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:38.175098 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b4c0e67c-5473-466a-9422-150ee91352d8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:38.176610 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b4c0e67c-5473-466a-9422-150ee91352d8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:38.177179 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-30d833cd-e38a-41d5-bb24-59e88b4401a9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:38.178097 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-30d833cd-e38a-41d5-bb24-59e88b4401a9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:38.178264 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b4c0e67c-5473-466a-9422-150ee91352d8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.264297 Jun 16 16:13:38.185751 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 76/143] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:37 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:38.186649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-30d833cd-e38a-41d5-bb24-59e88b4401a9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:38.187165 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-30d833cd-e38a-41d5-bb24-59e88b4401a9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:38.255271 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-30d833cd-e38a-41d5-bb24-59e88b4401a9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lazy-loading 'flavor' on Instance uuid 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:13:38.398697 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-30d833cd-e38a-41d5-bb24-59e88b4401a9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "POST /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1/action" status: 200 len: 32 microversion: 2.1 time: 0.234447 Jun 16 16:13:38.399756 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 68/144] 10.222.0.88 () {60 vars in 1277 bytes} [Thu Jun 16 16:13:38 2022] POST /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1/action => generated 32 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:13:38.410175 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-01daa991-8a29-401b-a8c4-9d47460705f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:38.411125 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-01daa991-8a29-401b-a8c4-9d47460705f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:38.418947 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01daa991-8a29-401b-a8c4-9d47460705f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:38.419917 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01daa991-8a29-401b-a8c4-9d47460705f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:38.421238 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01daa991-8a29-401b-a8c4-9d47460705f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:38.421875 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01daa991-8a29-401b-a8c4-9d47460705f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:38.575536 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-01daa991-8a29-401b-a8c4-9d47460705f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:38.583464 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-01daa991-8a29-401b-a8c4-9d47460705f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.178084 Jun 16 16:13:38.584297 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 77/145] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:38 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:38.769385 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-b011cbfe-daf7-4ede-8ace-b2b90435c513 req-8b6c0535-2d61-4381-9b69-c4fa8c56d7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79a464c4-3b6c-48f2-b733-8970ccf82e0d", "name": "network-vif-plugged", "status": "completed", "tag": "17ff1249-a9c6-473b-9c9c-1c74c01a15cc"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:38.789250 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-b011cbfe-daf7-4ede-8ace-b2b90435c513 req-8b6c0535-2d61-4381-9b69-c4fa8c56d7e0 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:38.789701 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-b011cbfe-daf7-4ede-8ace-b2b90435c513 req-8b6c0535-2d61-4381-9b69-c4fa8c56d7e0 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:38.802475 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-b011cbfe-daf7-4ede-8ace-b2b90435c513 req-8b6c0535-2d61-4381-9b69-c4fa8c56d7e0 service nova] Creating event network-vif-plugged:17ff1249-a9c6-473b-9c9c-1c74c01a15cc for instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d on hv-cinder-83735 Jun 16 16:13:38.809061 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-b011cbfe-daf7-4ede-8ace-b2b90435c513 req-8b6c0535-2d61-4381-9b69-c4fa8c56d7e0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046707 Jun 16 16:13:38.809711 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 69/146] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:13:38.921451 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2e7bf4ae-e775-4388-926f-9adfd5a29d1a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:38.922377 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2e7bf4ae-e775-4388-926f-9adfd5a29d1a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:38.935986 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2e7bf4ae-e775-4388-926f-9adfd5a29d1a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:38.936651 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2e7bf4ae-e775-4388-926f-9adfd5a29d1a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:38.937983 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2e7bf4ae-e775-4388-926f-9adfd5a29d1a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:38.939348 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2e7bf4ae-e775-4388-926f-9adfd5a29d1a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:39.185230 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-08c30d36-ae89-4114-8fcf-bf34ede4d219 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:39.186199 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-08c30d36-ae89-4114-8fcf-bf34ede4d219 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:39.195374 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08c30d36-ae89-4114-8fcf-bf34ede4d219 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:39.195964 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08c30d36-ae89-4114-8fcf-bf34ede4d219 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:39.197846 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08c30d36-ae89-4114-8fcf-bf34ede4d219 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:39.199045 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08c30d36-ae89-4114-8fcf-bf34ede4d219 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:39.208014 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2e7bf4ae-e775-4388-926f-9adfd5a29d1a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:39.217036 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2e7bf4ae-e775-4388-926f-9adfd5a29d1a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.300229 Jun 16 16:13:39.218007 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 78/147] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:38 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:39.224825 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9d0f817d-d3ab-456b-aac2-517bba057191 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:39.226062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9d0f817d-d3ab-456b-aac2-517bba057191 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:39.236486 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d0f817d-d3ab-456b-aac2-517bba057191 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:39.236941 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d0f817d-d3ab-456b-aac2-517bba057191 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:39.237758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d0f817d-d3ab-456b-aac2-517bba057191 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:39.238224 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d0f817d-d3ab-456b-aac2-517bba057191 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:39.242482 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=100 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:39.441349 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-08c30d36-ae89-4114-8fcf-bf34ede4d219 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:39.444262 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9d0f817d-d3ab-456b-aac2-517bba057191 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:39.449388 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-08c30d36-ae89-4114-8fcf-bf34ede4d219 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.268852 Jun 16 16:13:39.450132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 70/148] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:39 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:39.452707 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9d0f817d-d3ab-456b-aac2-517bba057191 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:39.454243 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9d0f817d-d3ab-456b-aac2-517bba057191 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:39.455354 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9d0f817d-d3ab-456b-aac2-517bba057191 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.236263 Jun 16 16:13:39.455920 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 79/149] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:39 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:39.601402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-561ba378-1870-4800-a2ad-9bd70b87951b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:39.602547 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-561ba378-1870-4800-a2ad-9bd70b87951b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:39.609980 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-561ba378-1870-4800-a2ad-9bd70b87951b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:39.610427 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-561ba378-1870-4800-a2ad-9bd70b87951b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:39.611231 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-561ba378-1870-4800-a2ad-9bd70b87951b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:39.611680 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-561ba378-1870-4800-a2ad-9bd70b87951b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:39.798405 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-561ba378-1870-4800-a2ad-9bd70b87951b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:39.808173 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-561ba378-1870-4800-a2ad-9bd70b87951b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.210463 Jun 16 16:13:39.808957 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 71/150] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:39 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:40.239776 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-270f758b-2f1f-4445-bc7e-fe8e3cc6febb tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:40.242767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-270f758b-2f1f-4445-bc7e-fe8e3cc6febb tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:40.255636 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-270f758b-2f1f-4445-bc7e-fe8e3cc6febb tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:40.257820 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-270f758b-2f1f-4445-bc7e-fe8e3cc6febb tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:40.265184 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-270f758b-2f1f-4445-bc7e-fe8e3cc6febb tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:40.266436 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-270f758b-2f1f-4445-bc7e-fe8e3cc6febb tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:40.469653 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e31fe23a-7ed2-4e94-9a5c-75ff23a316ce tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:40.469653 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e31fe23a-7ed2-4e94-9a5c-75ff23a316ce tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:40.475462 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e31fe23a-7ed2-4e94-9a5c-75ff23a316ce tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:40.475994 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e31fe23a-7ed2-4e94-9a5c-75ff23a316ce tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:40.476826 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e31fe23a-7ed2-4e94-9a5c-75ff23a316ce tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:40.477323 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e31fe23a-7ed2-4e94-9a5c-75ff23a316ce tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:40.515917 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-270f758b-2f1f-4445-bc7e-fe8e3cc6febb tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:40.526059 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-270f758b-2f1f-4445-bc7e-fe8e3cc6febb tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.292473 Jun 16 16:13:40.527691 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 80/151] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:40 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:40.533860 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3e6c8579-d307-41a2-be93-c0bb219fc634 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:40.535016 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3e6c8579-d307-41a2-be93-c0bb219fc634 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:40.543185 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3e6c8579-d307-41a2-be93-c0bb219fc634 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:40.544657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3e6c8579-d307-41a2-be93-c0bb219fc634 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:40.545821 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3e6c8579-d307-41a2-be93-c0bb219fc634 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:40.546521 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3e6c8579-d307-41a2-be93-c0bb219fc634 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:40.842361 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e31fe23a-7ed2-4e94-9a5c-75ff23a316ce tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:40.852995 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e31fe23a-7ed2-4e94-9a5c-75ff23a316ce tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.389899 Jun 16 16:13:40.865870 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 72/152] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:40 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:40.867904 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3e6c8579-d307-41a2-be93-c0bb219fc634 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:40.874253 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-02a3a264-2962-4314-904e-5a22d9bfba10 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:40.875235 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-02a3a264-2962-4314-904e-5a22d9bfba10 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:40.877444 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3e6c8579-d307-41a2-be93-c0bb219fc634 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:40.879044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3e6c8579-d307-41a2-be93-c0bb219fc634 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:40.880696 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3e6c8579-d307-41a2-be93-c0bb219fc634 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1406 microversion: 2.20 time: 0.351447 Jun 16 16:13:40.881308 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 81/153] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:40 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1406 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:40.897099 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-02a3a264-2962-4314-904e-5a22d9bfba10 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:40.897540 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-02a3a264-2962-4314-904e-5a22d9bfba10 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:40.898350 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-02a3a264-2962-4314-904e-5a22d9bfba10 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:40.898787 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-02a3a264-2962-4314-904e-5a22d9bfba10 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:41.068726 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-02a3a264-2962-4314-904e-5a22d9bfba10 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:41.077172 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-02a3a264-2962-4314-904e-5a22d9bfba10 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.209935 Jun 16 16:13:41.077776 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 73/154] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:40 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:41.543504 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-43c2107f-948e-4a26-b49b-c6a74bb49148 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:41.544366 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-43c2107f-948e-4a26-b49b-c6a74bb49148 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:41.554550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-43c2107f-948e-4a26-b49b-c6a74bb49148 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:41.555371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-43c2107f-948e-4a26-b49b-c6a74bb49148 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:41.562574 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-43c2107f-948e-4a26-b49b-c6a74bb49148 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:41.563355 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-43c2107f-948e-4a26-b49b-c6a74bb49148 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:41.784748 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-43c2107f-948e-4a26-b49b-c6a74bb49148 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:41.792524 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-43c2107f-948e-4a26-b49b-c6a74bb49148 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.252865 Jun 16 16:13:41.793117 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 82/155] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:41 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:41.873116 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-99c76564-4381-4076-817d-a811b4c02600 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:41.873798 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-99c76564-4381-4076-817d-a811b4c02600 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:41.880219 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-99c76564-4381-4076-817d-a811b4c02600 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:41.881058 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-99c76564-4381-4076-817d-a811b4c02600 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:41.882259 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-99c76564-4381-4076-817d-a811b4c02600 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:41.882792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-99c76564-4381-4076-817d-a811b4c02600 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:41.901809 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-88802b4c-202c-468a-a868-7d88f5a93f38 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:41.902907 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-88802b4c-202c-468a-a868-7d88f5a93f38 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:41.921510 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-88802b4c-202c-468a-a868-7d88f5a93f38 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:41.924466 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-88802b4c-202c-468a-a868-7d88f5a93f38 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:41.925940 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-88802b4c-202c-468a-a868-7d88f5a93f38 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:41.926904 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-88802b4c-202c-468a-a868-7d88f5a93f38 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:42.412180 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-99c76564-4381-4076-817d-a811b4c02600 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:42.429573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-99c76564-4381-4076-817d-a811b4c02600 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.559646 Jun 16 16:13:42.430661 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 74/156] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:41 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:42.437835 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-131a3188-4a67-4054-92b3-34a6088bbb58 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:42.439031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-131a3188-4a67-4054-92b3-34a6088bbb58 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:42.444910 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-88802b4c-202c-468a-a868-7d88f5a93f38 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:42.447606 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-131a3188-4a67-4054-92b3-34a6088bbb58 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:42.448100 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-131a3188-4a67-4054-92b3-34a6088bbb58 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:42.448874 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-131a3188-4a67-4054-92b3-34a6088bbb58 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:42.449313 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-131a3188-4a67-4054-92b3-34a6088bbb58 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:42.460415 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-88802b4c-202c-468a-a868-7d88f5a93f38 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:42.462331 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-88802b4c-202c-468a-a868-7d88f5a93f38 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:42.464085 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-88802b4c-202c-468a-a868-7d88f5a93f38 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1598 microversion: 2.20 time: 0.568646 Jun 16 16:13:42.464723 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 83/157] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:13:41 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1598 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:13:42.483276 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8624e28e-0eca-4fd9-a36c-0448571132ce tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:42.484081 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8624e28e-0eca-4fd9-a36c-0448571132ce tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:42.491264 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8624e28e-0eca-4fd9-a36c-0448571132ce tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:42.491760 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8624e28e-0eca-4fd9-a36c-0448571132ce tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:42.492579 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8624e28e-0eca-4fd9-a36c-0448571132ce tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:42.493187 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8624e28e-0eca-4fd9-a36c-0448571132ce tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:42.651026 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8624e28e-0eca-4fd9-a36c-0448571132ce tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.172030 Jun 16 16:13:42.652056 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 84/158] 10.222.0.88 () {60 vars in 1315 bytes} [Thu Jun 16 16:13:42 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:13:42.655941 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-131a3188-4a67-4054-92b3-34a6088bbb58 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:42.664940 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-131a3188-4a67-4054-92b3-34a6088bbb58 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.232920 Jun 16 16:13:42.665877 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 75/159] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:42 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:42.809643 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ac5b24d1-ce0c-42cb-a69f-06b35d03e473 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:42.810508 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ac5b24d1-ce0c-42cb-a69f-06b35d03e473 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:42.819385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ac5b24d1-ce0c-42cb-a69f-06b35d03e473 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:42.819888 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ac5b24d1-ce0c-42cb-a69f-06b35d03e473 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:42.820622 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ac5b24d1-ce0c-42cb-a69f-06b35d03e473 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:42.821050 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ac5b24d1-ce0c-42cb-a69f-06b35d03e473 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:43.447955 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-180de852-aebb-489d-989a-aa5b07c994b9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:43.449636 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-180de852-aebb-489d-989a-aa5b07c994b9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:43.456695 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-180de852-aebb-489d-989a-aa5b07c994b9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:43.457271 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-180de852-aebb-489d-989a-aa5b07c994b9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:43.458153 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-180de852-aebb-489d-989a-aa5b07c994b9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:43.458711 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-180de852-aebb-489d-989a-aa5b07c994b9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:43.479951 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:43.593588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ac5b24d1-ce0c-42cb-a69f-06b35d03e473 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:43.602725 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ac5b24d1-ce0c-42cb-a69f-06b35d03e473 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.797059 Jun 16 16:13:43.603708 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 85/160] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:42 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:43.684396 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-94e82839-26c8-43d4-b694-0409da3a964f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:43.685181 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-94e82839-26c8-43d4-b694-0409da3a964f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:43.691692 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-94e82839-26c8-43d4-b694-0409da3a964f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:43.692444 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-94e82839-26c8-43d4-b694-0409da3a964f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:43.693322 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-94e82839-26c8-43d4-b694-0409da3a964f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:43.694304 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-94e82839-26c8-43d4-b694-0409da3a964f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:43.817272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-180de852-aebb-489d-989a-aa5b07c994b9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:43.827558 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-180de852-aebb-489d-989a-aa5b07c994b9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.383919 Jun 16 16:13:43.828223 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 76/161] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:43 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:43.889923 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-94e82839-26c8-43d4-b694-0409da3a964f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:43.897871 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-94e82839-26c8-43d4-b694-0409da3a964f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.218671 Jun 16 16:13:43.898572 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 86/162] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:43 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:44.621084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ece4f10e-371e-4dee-bec1-6c46fad6adb5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:44.623038 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ece4f10e-371e-4dee-bec1-6c46fad6adb5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:44.629484 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ece4f10e-371e-4dee-bec1-6c46fad6adb5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:44.630069 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ece4f10e-371e-4dee-bec1-6c46fad6adb5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:44.631495 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ece4f10e-371e-4dee-bec1-6c46fad6adb5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:44.632061 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ece4f10e-371e-4dee-bec1-6c46fad6adb5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:44.811614 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-214d8764-cf28-495a-a5b6-ddc9c9a3f5d3 req-219bd4ae-404c-44bd-8223-29ff33157ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31998833-f554-4e9e-8215-6694a9d01970", "tag": "45b1ab78-929d-4b1a-90a1-4777fb503a47"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:44.832918 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-214d8764-cf28-495a-a5b6-ddc9c9a3f5d3 req-219bd4ae-404c-44bd-8223-29ff33157ab7 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:44.833965 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-214d8764-cf28-495a-a5b6-ddc9c9a3f5d3 req-219bd4ae-404c-44bd-8223-29ff33157ab7 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:44.849924 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-214d8764-cf28-495a-a5b6-ddc9c9a3f5d3 req-219bd4ae-404c-44bd-8223-29ff33157ab7 service nova] Creating event network-changed:45b1ab78-929d-4b1a-90a1-4777fb503a47 for instance 31998833-f554-4e9e-8215-6694a9d01970 on hv-cinder-83735 Jun 16 16:13:44.856904 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-214d8764-cf28-495a-a5b6-ddc9c9a3f5d3 req-219bd4ae-404c-44bd-8223-29ff33157ab7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050683 Jun 16 16:13:44.857207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ece4f10e-371e-4dee-bec1-6c46fad6adb5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:44.858515 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 87/163] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:13:44.866464 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-76cec486-0b93-44ab-b9d2-4bd1befbb62a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:44.867341 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-76cec486-0b93-44ab-b9d2-4bd1befbb62a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:44.872827 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ece4f10e-371e-4dee-bec1-6c46fad6adb5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.256097 Jun 16 16:13:44.873901 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 77/164] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:44 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:44.876161 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-76cec486-0b93-44ab-b9d2-4bd1befbb62a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:44.876828 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-76cec486-0b93-44ab-b9d2-4bd1befbb62a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:44.877785 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-76cec486-0b93-44ab-b9d2-4bd1befbb62a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:44.878390 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-76cec486-0b93-44ab-b9d2-4bd1befbb62a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:44.917535 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0d590f2d-f605-4694-9d0f-2c15cbd03e78 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:44.918552 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0d590f2d-f605-4694-9d0f-2c15cbd03e78 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:44.932832 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0d590f2d-f605-4694-9d0f-2c15cbd03e78 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:44.933806 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0d590f2d-f605-4694-9d0f-2c15cbd03e78 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:44.934967 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0d590f2d-f605-4694-9d0f-2c15cbd03e78 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:44.935973 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0d590f2d-f605-4694-9d0f-2c15cbd03e78 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:45.238795 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-76cec486-0b93-44ab-b9d2-4bd1befbb62a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:45.251312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-76cec486-0b93-44ab-b9d2-4bd1befbb62a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.391390 Jun 16 16:13:45.251935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 88/165] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:44 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:45.260552 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0d590f2d-f605-4694-9d0f-2c15cbd03e78 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:45.323127 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0d590f2d-f605-4694-9d0f-2c15cbd03e78 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.411767 Jun 16 16:13:45.337625 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 78/166] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:44 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:45.890779 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-171afd63-7b74-4c1f-a381-98351e9daaed tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:45.892020 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-171afd63-7b74-4c1f-a381-98351e9daaed tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:45.899635 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-171afd63-7b74-4c1f-a381-98351e9daaed tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:45.900382 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-171afd63-7b74-4c1f-a381-98351e9daaed tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:45.901270 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-171afd63-7b74-4c1f-a381-98351e9daaed tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:45.901957 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-171afd63-7b74-4c1f-a381-98351e9daaed tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:46.080318 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-171afd63-7b74-4c1f-a381-98351e9daaed tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:46.090661 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-171afd63-7b74-4c1f-a381-98351e9daaed tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.204215 Jun 16 16:13:46.094361 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 89/167] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:45 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:46.268520 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3b98609b-5fdc-4be4-9460-0171285539f0 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:46.269335 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3b98609b-5fdc-4be4-9460-0171285539f0 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:46.277451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3b98609b-5fdc-4be4-9460-0171285539f0 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:46.277974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3b98609b-5fdc-4be4-9460-0171285539f0 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:46.279171 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3b98609b-5fdc-4be4-9460-0171285539f0 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:46.279779 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3b98609b-5fdc-4be4-9460-0171285539f0 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:46.345157 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-75799a12-c685-4a47-a587-19036d7cf519 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:46.345959 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-75799a12-c685-4a47-a587-19036d7cf519 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:46.352790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-75799a12-c685-4a47-a587-19036d7cf519 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:46.353232 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-75799a12-c685-4a47-a587-19036d7cf519 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:46.356646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-75799a12-c685-4a47-a587-19036d7cf519 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:46.357089 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-75799a12-c685-4a47-a587-19036d7cf519 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:46.507819 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3b98609b-5fdc-4be4-9460-0171285539f0 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:46.515984 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3b98609b-5fdc-4be4-9460-0171285539f0 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.251189 Jun 16 16:13:46.516783 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 79/168] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:46 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:46.562098 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-75799a12-c685-4a47-a587-19036d7cf519 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:46.569881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-75799a12-c685-4a47-a587-19036d7cf519 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.229354 Jun 16 16:13:46.570788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 90/169] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:46 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:47.111730 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-45776134-aa5e-430c-8d47-e63e7bc131e8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:47.112331 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-45776134-aa5e-430c-8d47-e63e7bc131e8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:47.118295 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-45776134-aa5e-430c-8d47-e63e7bc131e8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:47.118760 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-45776134-aa5e-430c-8d47-e63e7bc131e8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:47.119514 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-45776134-aa5e-430c-8d47-e63e7bc131e8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:47.120755 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-45776134-aa5e-430c-8d47-e63e7bc131e8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:47.263249 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-45776134-aa5e-430c-8d47-e63e7bc131e8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:47.271633 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-45776134-aa5e-430c-8d47-e63e7bc131e8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.163687 Jun 16 16:13:47.272547 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 80/170] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:47 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:47.533127 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-826a1296-bd78-4685-81f4-3c7f0f712625 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:47.533895 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-826a1296-bd78-4685-81f4-3c7f0f712625 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:47.540587 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-826a1296-bd78-4685-81f4-3c7f0f712625 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:47.541213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-826a1296-bd78-4685-81f4-3c7f0f712625 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:47.542125 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-826a1296-bd78-4685-81f4-3c7f0f712625 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:47.542642 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-826a1296-bd78-4685-81f4-3c7f0f712625 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:47.587643 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5553fa70-908f-491f-b82f-40c6a928e327 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:47.588245 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5553fa70-908f-491f-b82f-40c6a928e327 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:47.594636 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5553fa70-908f-491f-b82f-40c6a928e327 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:47.595082 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5553fa70-908f-491f-b82f-40c6a928e327 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:47.596005 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5553fa70-908f-491f-b82f-40c6a928e327 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:47.596865 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5553fa70-908f-491f-b82f-40c6a928e327 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:47.735199 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-826a1296-bd78-4685-81f4-3c7f0f712625 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:47.743534 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-826a1296-bd78-4685-81f4-3c7f0f712625 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.214224 Jun 16 16:13:47.744491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 91/171] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:47 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:47.768837 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5553fa70-908f-491f-b82f-40c6a928e327 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:47.777825 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5553fa70-908f-491f-b82f-40c6a928e327 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.193882 Jun 16 16:13:47.778413 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 81/172] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:47 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:48.289543 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e57f4cab-5aee-4e00-afb3-4b704e8070e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:48.290704 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e57f4cab-5aee-4e00-afb3-4b704e8070e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:48.297028 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e57f4cab-5aee-4e00-afb3-4b704e8070e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:48.297682 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e57f4cab-5aee-4e00-afb3-4b704e8070e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:48.298791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e57f4cab-5aee-4e00-afb3-4b704e8070e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:48.299346 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e57f4cab-5aee-4e00-afb3-4b704e8070e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:48.467108 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e57f4cab-5aee-4e00-afb3-4b704e8070e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:48.485055 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e57f4cab-5aee-4e00-afb3-4b704e8070e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.191973 Jun 16 16:13:48.485882 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 92/173] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:48 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:48.764134 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-463b1bda-4cae-45f7-8d19-946799187da4 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:48.770551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-463b1bda-4cae-45f7-8d19-946799187da4 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:48.777835 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-463b1bda-4cae-45f7-8d19-946799187da4 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:48.779408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-463b1bda-4cae-45f7-8d19-946799187da4 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:48.780348 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-463b1bda-4cae-45f7-8d19-946799187da4 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:48.780783 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-463b1bda-4cae-45f7-8d19-946799187da4 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:48.795706 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-517959a7-07f2-421f-bd77-ba926bc1a95a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:48.797095 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-517959a7-07f2-421f-bd77-ba926bc1a95a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:48.808169 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-517959a7-07f2-421f-bd77-ba926bc1a95a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:48.809043 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-517959a7-07f2-421f-bd77-ba926bc1a95a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:48.809403 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-517959a7-07f2-421f-bd77-ba926bc1a95a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:48.814753 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-517959a7-07f2-421f-bd77-ba926bc1a95a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:49.037068 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-463b1bda-4cae-45f7-8d19-946799187da4 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:49.050464 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-463b1bda-4cae-45f7-8d19-946799187da4 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.293605 Jun 16 16:13:49.051307 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 82/174] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:48 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:49.052705 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-517959a7-07f2-421f-bd77-ba926bc1a95a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:49.060510 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-517959a7-07f2-421f-bd77-ba926bc1a95a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.269338 Jun 16 16:13:49.069710 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 93/175] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:48 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:49.503346 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1efff23c-bcd7-4794-9421-6e990b30ab53 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:49.503947 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1efff23c-bcd7-4794-9421-6e990b30ab53 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:49.510000 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1efff23c-bcd7-4794-9421-6e990b30ab53 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:49.510892 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1efff23c-bcd7-4794-9421-6e990b30ab53 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:49.511656 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1efff23c-bcd7-4794-9421-6e990b30ab53 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:49.512092 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1efff23c-bcd7-4794-9421-6e990b30ab53 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:49.648641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1efff23c-bcd7-4794-9421-6e990b30ab53 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:49.656840 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1efff23c-bcd7-4794-9421-6e990b30ab53 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.158329 Jun 16 16:13:49.657527 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 83/176] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:49 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:50.067764 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6952a017-9c5c-45c1-a369-6c57575ebc04 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:50.069284 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6952a017-9c5c-45c1-a369-6c57575ebc04 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:50.076868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6952a017-9c5c-45c1-a369-6c57575ebc04 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:50.077663 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6952a017-9c5c-45c1-a369-6c57575ebc04 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:50.078512 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6952a017-9c5c-45c1-a369-6c57575ebc04 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:50.078973 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-82052254-b462-464d-84d9-5bff4322d596 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:50.079582 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-82052254-b462-464d-84d9-5bff4322d596 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:50.080050 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6952a017-9c5c-45c1-a369-6c57575ebc04 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:50.088991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-82052254-b462-464d-84d9-5bff4322d596 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:50.089336 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-82052254-b462-464d-84d9-5bff4322d596 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:50.090056 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-82052254-b462-464d-84d9-5bff4322d596 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:50.090499 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-82052254-b462-464d-84d9-5bff4322d596 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:50.671224 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6952a017-9c5c-45c1-a369-6c57575ebc04 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:50.687620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6952a017-9c5c-45c1-a369-6c57575ebc04 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.623596 Jun 16 16:13:50.688231 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 94/177] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:50 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:50.701055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-82052254-b462-464d-84d9-5bff4322d596 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:50.702362 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f4091376-34c5-4855-ac93-c67808de5959 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:50.703483 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f4091376-34c5-4855-ac93-c67808de5959 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:50.711514 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f4091376-34c5-4855-ac93-c67808de5959 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:50.712111 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f4091376-34c5-4855-ac93-c67808de5959 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:50.714027 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f4091376-34c5-4855-ac93-c67808de5959 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:50.714385 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-82052254-b462-464d-84d9-5bff4322d596 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.635972 Jun 16 16:13:50.714931 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f4091376-34c5-4855-ac93-c67808de5959 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:50.715173 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 84/178] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:50 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:50.935297 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f4091376-34c5-4855-ac93-c67808de5959 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:50.943241 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f4091376-34c5-4855-ac93-c67808de5959 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.244709 Jun 16 16:13:50.943819 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 95/179] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:50 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:51.704578 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7147960b-aff1-47fa-9813-77e5d94a836a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:51.705203 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7147960b-aff1-47fa-9813-77e5d94a836a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:51.711580 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7147960b-aff1-47fa-9813-77e5d94a836a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:51.712036 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7147960b-aff1-47fa-9813-77e5d94a836a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:51.712810 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7147960b-aff1-47fa-9813-77e5d94a836a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:51.713278 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7147960b-aff1-47fa-9813-77e5d94a836a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:51.734367 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a386b0c6-16d7-45fc-b5af-4e06525397f3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:51.735200 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a386b0c6-16d7-45fc-b5af-4e06525397f3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:51.742954 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a386b0c6-16d7-45fc-b5af-4e06525397f3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:51.743507 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a386b0c6-16d7-45fc-b5af-4e06525397f3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:51.744358 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a386b0c6-16d7-45fc-b5af-4e06525397f3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:51.745047 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a386b0c6-16d7-45fc-b5af-4e06525397f3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:52.018162 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7147960b-aff1-47fa-9813-77e5d94a836a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:52.027426 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7147960b-aff1-47fa-9813-77e5d94a836a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.326691 Jun 16 16:13:52.037226 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a386b0c6-16d7-45fc-b5af-4e06525397f3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:52.037226 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=100 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:52.038782 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 85/180] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:51 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:52.042618 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a386b0c6-16d7-45fc-b5af-4e06525397f3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.313582 Jun 16 16:13:52.043206 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 96/181] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:51 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:52.047503 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-dc1e0d2e-86ee-4ac4-bc38-27f705fb2e83 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:52.051383 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dc1e0d2e-86ee-4ac4-bc38-27f705fb2e83 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:52.058569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dc1e0d2e-86ee-4ac4-bc38-27f705fb2e83 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:52.059184 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dc1e0d2e-86ee-4ac4-bc38-27f705fb2e83 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:52.059955 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dc1e0d2e-86ee-4ac4-bc38-27f705fb2e83 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:52.060389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dc1e0d2e-86ee-4ac4-bc38-27f705fb2e83 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:52.290734 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dc1e0d2e-86ee-4ac4-bc38-27f705fb2e83 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:52.300646 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-dc1e0d2e-86ee-4ac4-bc38-27f705fb2e83 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.257033 Jun 16 16:13:52.301395 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 86/182] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:52 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:53.047438 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-60cd5660-786c-4736-b942-219553ab1f90 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:53.049006 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-60cd5660-786c-4736-b942-219553ab1f90 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:53.059944 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a717397b-5278-44ed-a834-6eef9827996c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:53.061427 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a717397b-5278-44ed-a834-6eef9827996c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:53.075466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a717397b-5278-44ed-a834-6eef9827996c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:53.077833 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a717397b-5278-44ed-a834-6eef9827996c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:53.085605 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a717397b-5278-44ed-a834-6eef9827996c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:53.086317 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a717397b-5278-44ed-a834-6eef9827996c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:53.086836 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-60cd5660-786c-4736-b942-219553ab1f90 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:53.087608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-60cd5660-786c-4736-b942-219553ab1f90 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:53.090760 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-60cd5660-786c-4736-b942-219553ab1f90 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:53.091439 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-60cd5660-786c-4736-b942-219553ab1f90 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:53.454093 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-60cd5660-786c-4736-b942-219553ab1f90 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:53.466852 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-60cd5660-786c-4736-b942-219553ab1f90 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1315 microversion: 2.1 time: 0.425719 Jun 16 16:13:53.467745 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 97/183] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:53 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:53.474469 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2b0830e3-d197-49c3-bdac-f70e0380dc73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:53.475096 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2b0830e3-d197-49c3-bdac-f70e0380dc73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:53.483515 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2b0830e3-d197-49c3-bdac-f70e0380dc73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:53.484349 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2b0830e3-d197-49c3-bdac-f70e0380dc73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:53.485704 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2b0830e3-d197-49c3-bdac-f70e0380dc73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:53.486143 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2b0830e3-d197-49c3-bdac-f70e0380dc73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:53.513928 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a717397b-5278-44ed-a834-6eef9827996c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:53.532641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a717397b-5278-44ed-a834-6eef9827996c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.477041 Jun 16 16:13:53.534031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 87/184] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:53 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:53.666505 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2b0830e3-d197-49c3-bdac-f70e0380dc73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:53.675803 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2b0830e3-d197-49c3-bdac-f70e0380dc73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.206335 Jun 16 16:13:53.677671 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 98/185] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:53 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:53.768421 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-83a5f0b5-b4e7-4a95-b2a3-8cbe34ab350e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1327092082", "imageRef": "d2716dc1-3d4d-4f62-b0af-c38986f2a3aa", "flavorRef": "452", "networks": [{"uuid": "3a8a4182-9bbd-4e72-b4bc-641fd3edab1a"}]}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:53.837509 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-83a5f0b5-b4e7-4a95-b2a3-8cbe34ab350e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] validate_networks() for [('3a8a4182-9bbd-4e72-b4bc-641fd3edab1a', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:13:54.242233 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-83a5f0b5-b4e7-4a95-b2a3-8cbe34ab350e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:13:54.242920 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-83a5f0b5-b4e7-4a95-b2a3-8cbe34ab350e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:13:54.243115 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-83a5f0b5-b4e7-4a95-b2a3-8cbe34ab350e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:13:54.243705 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-83a5f0b5-b4e7-4a95-b2a3-8cbe34ab350e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:13:54.244250 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-83a5f0b5-b4e7-4a95-b2a3-8cbe34ab350e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:13:54.256382 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-83a5f0b5-b4e7-4a95-b2a3-8cbe34ab350e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:54.256926 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-83a5f0b5-b4e7-4a95-b2a3-8cbe34ab350e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:54.258501 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-83a5f0b5-b4e7-4a95-b2a3-8cbe34ab350e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:54.259180 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-83a5f0b5-b4e7-4a95-b2a3-8cbe34ab350e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:54.313323 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-83a5f0b5-b4e7-4a95-b2a3-8cbe34ab350e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Getting quotas for project f5e363bcf5ed47529b6464cf954a31ea. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:13:54.328493 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-83a5f0b5-b4e7-4a95-b2a3-8cbe34ab350e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Getting quotas for user 1a98ea9b90174a24b57b3875e9df2ecd and project f5e363bcf5ed47529b6464cf954a31ea. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:13:54.393102 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-83a5f0b5-b4e7-4a95-b2a3-8cbe34ab350e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:13:54.400079 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-83a5f0b5-b4e7-4a95-b2a3-8cbe34ab350e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2716dc1-3d4d-4f62-b0af-c38986f2a3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:13:54.506136 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a1ed52bc-e64f-42d7-aa19-42736201a07c tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:54.507416 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a1ed52bc-e64f-42d7-aa19-42736201a07c tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:54.517168 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a1ed52bc-e64f-42d7-aa19-42736201a07c tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:54.518778 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a1ed52bc-e64f-42d7-aa19-42736201a07c tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:54.520553 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a1ed52bc-e64f-42d7-aa19-42736201a07c tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:54.524112 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a1ed52bc-e64f-42d7-aa19-42736201a07c tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:54.565858 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-83a5f0b5-b4e7-4a95-b2a3-8cbe34ab350e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.800175 Jun 16 16:13:54.570595 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 88/186] 10.222.0.88 () {60 vars in 1146 bytes} [Thu Jun 16 16:13:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:13:54.578951 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b031cd0c-5459-4086-8db4-76a930d9a65d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:54.580632 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b031cd0c-5459-4086-8db4-76a930d9a65d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:54.589940 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b031cd0c-5459-4086-8db4-76a930d9a65d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:54.589940 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b031cd0c-5459-4086-8db4-76a930d9a65d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:54.606639 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b031cd0c-5459-4086-8db4-76a930d9a65d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:54.607694 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b031cd0c-5459-4086-8db4-76a930d9a65d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:54.895099 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a1ed52bc-e64f-42d7-aa19-42736201a07c tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:54.904935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a1ed52bc-e64f-42d7-aa19-42736201a07c tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1503 microversion: 2.1 time: 0.407309 Jun 16 16:13:54.908580 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 99/187] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:54 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1503 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:54.923117 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3985bb32-56b0-4be4-a17c-a04ff97a5034 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:54.923728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3985bb32-56b0-4be4-a17c-a04ff97a5034 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:54.948423 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b031cd0c-5459-4086-8db4-76a930d9a65d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:54.957257 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b031cd0c-5459-4086-8db4-76a930d9a65d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.385235 Jun 16 16:13:54.958506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 89/188] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:54 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:54.970770 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-aa66199e-b5f6-4940-9644-699fa1e7c23e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:54.971689 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-aa66199e-b5f6-4940-9644-699fa1e7c23e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:54.998764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa66199e-b5f6-4940-9644-699fa1e7c23e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:55.000830 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa66199e-b5f6-4940-9644-699fa1e7c23e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:55.006496 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa66199e-b5f6-4940-9644-699fa1e7c23e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:55.007155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa66199e-b5f6-4940-9644-699fa1e7c23e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:55.032803 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3985bb32-56b0-4be4-a17c-a04ff97a5034 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:55.042524 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3985bb32-56b0-4be4-a17c-a04ff97a5034 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1219 microversion: 2.1 time: 0.132805 Jun 16 16:13:55.043400 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 100/189] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:54 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:55.247656 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-aa66199e-b5f6-4940-9644-699fa1e7c23e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:55.262176 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-aa66199e-b5f6-4940-9644-699fa1e7c23e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.300889 Jun 16 16:13:55.264626 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 90/190] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:54 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:55.977275 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-70e99b62-8401-4cd6-acbb-9684848687b3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:55.978559 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-70e99b62-8401-4cd6-acbb-9684848687b3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:55.990089 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-70e99b62-8401-4cd6-acbb-9684848687b3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:55.991299 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-70e99b62-8401-4cd6-acbb-9684848687b3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:55.993476 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-70e99b62-8401-4cd6-acbb-9684848687b3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:55.994177 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-70e99b62-8401-4cd6-acbb-9684848687b3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:56.060430 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b2e2ae3d-1579-4a1d-8294-633a8de217df tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:56.061899 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b2e2ae3d-1579-4a1d-8294-633a8de217df tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:56.068760 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b2e2ae3d-1579-4a1d-8294-633a8de217df tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:56.069598 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b2e2ae3d-1579-4a1d-8294-633a8de217df tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:56.070647 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b2e2ae3d-1579-4a1d-8294-633a8de217df tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:56.071429 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b2e2ae3d-1579-4a1d-8294-633a8de217df tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:56.364367 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b2e2ae3d-1579-4a1d-8294-633a8de217df tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:56.379872 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b2e2ae3d-1579-4a1d-8294-633a8de217df tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1271 microversion: 2.1 time: 0.323897 Jun 16 16:13:56.380573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 91/191] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:56 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1271 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:13:56.394691 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7d7ec4f3-22ba-4ecf-a04f-50236a7ec7e1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:56.395465 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7d7ec4f3-22ba-4ecf-a04f-50236a7ec7e1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:56.412947 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7d7ec4f3-22ba-4ecf-a04f-50236a7ec7e1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:56.413393 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7d7ec4f3-22ba-4ecf-a04f-50236a7ec7e1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:56.414345 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7d7ec4f3-22ba-4ecf-a04f-50236a7ec7e1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:56.414655 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7d7ec4f3-22ba-4ecf-a04f-50236a7ec7e1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:56.719856 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-70e99b62-8401-4cd6-acbb-9684848687b3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:56.749211 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-70e99b62-8401-4cd6-acbb-9684848687b3 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.775627 Jun 16 16:13:56.749211 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 101/192] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:55 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:57.047411 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7d7ec4f3-22ba-4ecf-a04f-50236a7ec7e1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:57.075837 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7d7ec4f3-22ba-4ecf-a04f-50236a7ec7e1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.694046 Jun 16 16:13:57.077379 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 92/193] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:56 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:57.163770 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-185f8693-9993-4264-9a90-9b98faf91f1a req-f3113df3-4c47-42bf-a832-3e73e803b7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6776a1f2-1043-4048-99e7-cdc91959fe40", "name": "network-vif-plugged", "status": "completed", "tag": "7a7bf458-a30a-41d7-a812-b5387bf22d99"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:57.185739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-185f8693-9993-4264-9a90-9b98faf91f1a req-f3113df3-4c47-42bf-a832-3e73e803b7f6 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:57.189180 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-185f8693-9993-4264-9a90-9b98faf91f1a req-f3113df3-4c47-42bf-a832-3e73e803b7f6 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:57.218829 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-185f8693-9993-4264-9a90-9b98faf91f1a req-f3113df3-4c47-42bf-a832-3e73e803b7f6 service nova] Creating event network-vif-plugged:7a7bf458-a30a-41d7-a812-b5387bf22d99 for instance 6776a1f2-1043-4048-99e7-cdc91959fe40 on hv-cinder-83735 Jun 16 16:13:57.231330 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-185f8693-9993-4264-9a90-9b98faf91f1a req-f3113df3-4c47-42bf-a832-3e73e803b7f6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072763 Jun 16 16:13:57.233495 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 102/194] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:13:57.407077 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4871e06e-dfa5-4892-90f6-3c818d4a129c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:57.407753 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4871e06e-dfa5-4892-90f6-3c818d4a129c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:57.423545 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4871e06e-dfa5-4892-90f6-3c818d4a129c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:57.427917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4871e06e-dfa5-4892-90f6-3c818d4a129c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:57.430015 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4871e06e-dfa5-4892-90f6-3c818d4a129c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:57.430482 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4871e06e-dfa5-4892-90f6-3c818d4a129c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:57.657104 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4871e06e-dfa5-4892-90f6-3c818d4a129c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:57.660738 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=100 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:13:57.674841 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4871e06e-dfa5-4892-90f6-3c818d4a129c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1277 microversion: 2.1 time: 0.273957 Jun 16 16:13:57.677568 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 93/195] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:57 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1277 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:57.766986 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f3e4198e-bf98-436b-98a5-c4dafaeae7d9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:57.768223 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f3e4198e-bf98-436b-98a5-c4dafaeae7d9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:57.783035 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3e4198e-bf98-436b-98a5-c4dafaeae7d9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:57.783488 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3e4198e-bf98-436b-98a5-c4dafaeae7d9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:57.786236 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3e4198e-bf98-436b-98a5-c4dafaeae7d9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:57.786706 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3e4198e-bf98-436b-98a5-c4dafaeae7d9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:57.807692 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f211180e-1650-4b16-935a-7a7703cb7167 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea2674ff-1873-4b84-b5f6-bb73184503a4"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:13:57.808879 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f211180e-1650-4b16-935a-7a7703cb7167 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:57.823833 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f211180e-1650-4b16-935a-7a7703cb7167 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:57.827183 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f211180e-1650-4b16-935a-7a7703cb7167 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:57.828209 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f211180e-1650-4b16-935a-7a7703cb7167 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:57.832981 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f211180e-1650-4b16-935a-7a7703cb7167 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:58.309545 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f3e4198e-bf98-436b-98a5-c4dafaeae7d9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:58.325207 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f3e4198e-bf98-436b-98a5-c4dafaeae7d9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.563090 Jun 16 16:13:58.328020 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 103/196] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:57 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:58.343639 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c5b93937-2a58-4489-8665-34b47cabeadc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:58.346423 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c5b93937-2a58-4489-8665-34b47cabeadc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:58.371012 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c5b93937-2a58-4489-8665-34b47cabeadc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:58.371789 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c5b93937-2a58-4489-8665-34b47cabeadc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:58.373979 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c5b93937-2a58-4489-8665-34b47cabeadc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:58.375768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c5b93937-2a58-4489-8665-34b47cabeadc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:58.930636 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f211180e-1650-4b16-935a-7a7703cb7167 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "POST /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.127679 Jun 16 16:13:58.948232 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 94/197] 10.222.0.88 () {60 vars in 1322 bytes} [Thu Jun 16 16:13:57 2022] POST /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d/os-volume_attachments => generated 194 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:13:58.964121 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-51d983cd-3d94-4b8d-8aef-932a6d285e2c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:58.981573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-51d983cd-3d94-4b8d-8aef-932a6d285e2c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:59.012606 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-51d983cd-3d94-4b8d-8aef-932a6d285e2c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:59.021441 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-51d983cd-3d94-4b8d-8aef-932a6d285e2c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:59.026275 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c5b93937-2a58-4489-8665-34b47cabeadc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:59.028319 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-51d983cd-3d94-4b8d-8aef-932a6d285e2c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:59.032438 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-51d983cd-3d94-4b8d-8aef-932a6d285e2c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:59.037325 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c5b93937-2a58-4489-8665-34b47cabeadc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.706802 Jun 16 16:13:59.037970 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 104/198] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:58 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:59.344957 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e4788523-79af-48b2-a4b8-a99e099abea1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:13:59.347205 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e4788523-79af-48b2-a4b8-a99e099abea1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:13:59.356617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e4788523-79af-48b2-a4b8-a99e099abea1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:59.360948 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e4788523-79af-48b2-a4b8-a99e099abea1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:59.366373 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e4788523-79af-48b2-a4b8-a99e099abea1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:13:59.367125 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e4788523-79af-48b2-a4b8-a99e099abea1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:13:59.374202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-51d983cd-3d94-4b8d-8aef-932a6d285e2c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:59.386573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-51d983cd-3d94-4b8d-8aef-932a6d285e2c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.435313 Jun 16 16:13:59.398233 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 95/199] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:58 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:13:59.667564 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e4788523-79af-48b2-a4b8-a99e099abea1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:13:59.681164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e4788523-79af-48b2-a4b8-a99e099abea1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.341710 Jun 16 16:13:59.689174 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 105/200] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:13:59 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:00.060541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9fbeab1b-2b36-425b-857b-d1cf793e837d tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:00.061387 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9fbeab1b-2b36-425b-857b-d1cf793e837d tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:00.078909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9fbeab1b-2b36-425b-857b-d1cf793e837d tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:00.079467 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9fbeab1b-2b36-425b-857b-d1cf793e837d tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:00.084016 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9fbeab1b-2b36-425b-857b-d1cf793e837d tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:00.084689 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9fbeab1b-2b36-425b-857b-d1cf793e837d tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:00.404315 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a611291a-3ebf-4566-a7a9-473ea531dc8c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:00.405125 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a611291a-3ebf-4566-a7a9-473ea531dc8c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:00.429159 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a611291a-3ebf-4566-a7a9-473ea531dc8c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:00.429424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a611291a-3ebf-4566-a7a9-473ea531dc8c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:00.430249 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a611291a-3ebf-4566-a7a9-473ea531dc8c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:00.430684 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a611291a-3ebf-4566-a7a9-473ea531dc8c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:00.758326 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9fbeab1b-2b36-425b-857b-d1cf793e837d tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:00.768902 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9fbeab1b-2b36-425b-857b-d1cf793e837d tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1367 microversion: 2.1 time: 0.717792 Jun 16 16:14:00.769678 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 96/201] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:00 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1367 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:00.784609 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3551cd36-8d17-462d-b10d-0804f3c6efa5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:00.785527 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3551cd36-8d17-462d-b10d-0804f3c6efa5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:00.792731 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3551cd36-8d17-462d-b10d-0804f3c6efa5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:00.793775 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3551cd36-8d17-462d-b10d-0804f3c6efa5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:00.794904 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3551cd36-8d17-462d-b10d-0804f3c6efa5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:00.795492 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3551cd36-8d17-462d-b10d-0804f3c6efa5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:00.844047 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a611291a-3ebf-4566-a7a9-473ea531dc8c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:00.869450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a611291a-3ebf-4566-a7a9-473ea531dc8c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.469279 Jun 16 16:14:00.871819 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 106/202] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:00 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:01.054324 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3551cd36-8d17-462d-b10d-0804f3c6efa5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:01.070810 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3551cd36-8d17-462d-b10d-0804f3c6efa5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.287320 Jun 16 16:14:01.072643 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 97/203] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:00 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:01.458447 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-852c61c1-38a4-417b-8941-69557a8b356c req-3d9f300e-75ee-4408-a45a-0aa2b34f32d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa2fe4ab-2e04-4754-8301-e0c6666f1c61", "tag": "3f5a0aae-f27d-4b24-94b2-031c768b687b"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:01.487959 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-852c61c1-38a4-417b-8941-69557a8b356c req-3d9f300e-75ee-4408-a45a-0aa2b34f32d1 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:01.489223 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-852c61c1-38a4-417b-8941-69557a8b356c req-3d9f300e-75ee-4408-a45a-0aa2b34f32d1 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:01.519865 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ca985433-1d81-462d-aad4-4e13c10ef15f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Action: 'create', calling method: .version_select at 0x7f6f0d4fac10>, body: {"keypair": {"name": "tempest-TestShelveInstance-945213920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKApA5vOHSmampIxa7kkE/zkqLs7EwvB4CZqy7q8eQh1QP4jD4huQgaLquaGDT5OwIWThF36xh6ZmFi0rxic+85SI8xwWFvjaumoP/52sn5kh4X+B/yzpeby8Aehp4uEJw=="}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:01.523410 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-852c61c1-38a4-417b-8941-69557a8b356c req-3d9f300e-75ee-4408-a45a-0aa2b34f32d1 service nova] Creating event network-changed:3f5a0aae-f27d-4b24-94b2-031c768b687b for instance aa2fe4ab-2e04-4754-8301-e0c6666f1c61 on hv-cinder-83735 Jun 16 16:14:01.539740 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-852c61c1-38a4-417b-8941-69557a8b356c req-3d9f300e-75ee-4408-a45a-0aa2b34f32d1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089508 Jun 16 16:14:01.543570 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-ca985433-1d81-462d-aad4-4e13c10ef15f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Getting quotas for project aed429e2356c4c7a83872d82c0540b66. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:14:01.543956 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 98/204] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:01.547902 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-ca985433-1d81-462d-aad4-4e13c10ef15f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Getting quotas for user 578e9a80847d4fb18e9ea43a3ed7e8f5 and project aed429e2356c4c7a83872d82c0540b66. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:14:01.579099 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ca985433-1d81-462d-aad4-4e13c10ef15f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.452218 Jun 16 16:14:01.580067 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 107/205] 10.222.0.88 () {60 vars in 1158 bytes} [Thu Jun 16 16:14:01 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:01.787974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0ceb81f3-653a-4ccd-b19f-11e036228a2f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:01.788895 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0ceb81f3-653a-4ccd-b19f-11e036228a2f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:01.797336 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0ceb81f3-653a-4ccd-b19f-11e036228a2f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:01.803791 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0ceb81f3-653a-4ccd-b19f-11e036228a2f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:01.804085 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0ceb81f3-653a-4ccd-b19f-11e036228a2f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:01.804429 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0ceb81f3-653a-4ccd-b19f-11e036228a2f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:01.894288 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b5764f71-922a-48dc-8664-0babb084facf tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:01.895075 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b5764f71-922a-48dc-8664-0babb084facf tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:01.904115 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b5764f71-922a-48dc-8664-0babb084facf tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:01.904733 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b5764f71-922a-48dc-8664-0babb084facf tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:01.905609 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b5764f71-922a-48dc-8664-0babb084facf tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:01.906362 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b5764f71-922a-48dc-8664-0babb084facf tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:02.440797 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b5764f71-922a-48dc-8664-0babb084facf tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:02.454798 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0ceb81f3-653a-4ccd-b19f-11e036228a2f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:02.468591 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b5764f71-922a-48dc-8664-0babb084facf tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.582597 Jun 16 16:14:02.470262 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 108/206] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:01 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:02.481821 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0ceb81f3-653a-4ccd-b19f-11e036228a2f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1558 microversion: 2.1 time: 0.698199 Jun 16 16:14:02.483990 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 99/207] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:01 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1558 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:02.493476 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-23cc16fa-c164-4a31-9bf3-709699975ab9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:02.496122 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-23cc16fa-c164-4a31-9bf3-709699975ab9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:02.504347 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4d3c70ed-45a0-4238-889c-72cb0d898a4a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:02.506202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4d3c70ed-45a0-4238-889c-72cb0d898a4a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:02.510459 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-23cc16fa-c164-4a31-9bf3-709699975ab9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:02.511616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-23cc16fa-c164-4a31-9bf3-709699975ab9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:02.512755 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-23cc16fa-c164-4a31-9bf3-709699975ab9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:02.513650 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-23cc16fa-c164-4a31-9bf3-709699975ab9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:02.529703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4d3c70ed-45a0-4238-889c-72cb0d898a4a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:02.531864 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4d3c70ed-45a0-4238-889c-72cb0d898a4a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:02.535637 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4d3c70ed-45a0-4238-889c-72cb0d898a4a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:02.536754 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4d3c70ed-45a0-4238-889c-72cb0d898a4a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:02.850635 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4d3c70ed-45a0-4238-889c-72cb0d898a4a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.353015 Jun 16 16:14:02.851513 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 100/208] 10.222.0.88 () {58 vars in 1274 bytes} [Thu Jun 16 16:14:02 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40/os-interface => generated 285 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:02.922937 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-23cc16fa-c164-4a31-9bf3-709699975ab9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:02.934447 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-23cc16fa-c164-4a31-9bf3-709699975ab9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.461981 Jun 16 16:14:02.935044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 109/209] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:02 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:03.491260 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7b49deba-28df-48bd-a118-81ecca515f41 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:03.492775 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7b49deba-28df-48bd-a118-81ecca515f41 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:03.508407 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7b49deba-28df-48bd-a118-81ecca515f41 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:03.512185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7b49deba-28df-48bd-a118-81ecca515f41 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:03.514593 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7b49deba-28df-48bd-a118-81ecca515f41 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:03.516276 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7b49deba-28df-48bd-a118-81ecca515f41 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:03.786452 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7b49deba-28df-48bd-a118-81ecca515f41 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:03.797484 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7b49deba-28df-48bd-a118-81ecca515f41 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.312728 Jun 16 16:14:03.798712 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 101/210] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:03 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:03.956388 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-95308437-c7d6-4f01-8dc7-34453b6d470d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:03.957173 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-95308437-c7d6-4f01-8dc7-34453b6d470d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:03.977426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-95308437-c7d6-4f01-8dc7-34453b6d470d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:03.983882 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-95308437-c7d6-4f01-8dc7-34453b6d470d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:03.987464 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-95308437-c7d6-4f01-8dc7-34453b6d470d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:03.994695 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-95308437-c7d6-4f01-8dc7-34453b6d470d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:04.281102 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-95308437-c7d6-4f01-8dc7-34453b6d470d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:04.290626 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-95308437-c7d6-4f01-8dc7-34453b6d470d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.341292 Jun 16 16:14:04.293825 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 110/211] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:03 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:04.448293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-ba10a344-05f1-4387-b0df-837b2e7cb684 req-fcc520fa-1100-41f5-8300-d77016bae584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6776a1f2-1043-4048-99e7-cdc91959fe40", "tag": "7a7bf458-a30a-41d7-a812-b5387bf22d99"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:04.453259 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:04.463070 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=6 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:04.470397 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-ba10a344-05f1-4387-b0df-837b2e7cb684 req-fcc520fa-1100-41f5-8300-d77016bae584 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:04.470808 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-ba10a344-05f1-4387-b0df-837b2e7cb684 req-fcc520fa-1100-41f5-8300-d77016bae584 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:04.493975 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-ba10a344-05f1-4387-b0df-837b2e7cb684 req-fcc520fa-1100-41f5-8300-d77016bae584 service nova] Creating event network-changed:7a7bf458-a30a-41d7-a812-b5387bf22d99 for instance 6776a1f2-1043-4048-99e7-cdc91959fe40 on hv-cinder-83735 Jun 16 16:14:04.501571 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-ba10a344-05f1-4387-b0df-837b2e7cb684 req-fcc520fa-1100-41f5-8300-d77016bae584 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062279 Jun 16 16:14:04.502464 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 102/212] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:04.816168 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-826603cb-0f97-4229-99c4-09a8d8c7400b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:04.818522 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-826603cb-0f97-4229-99c4-09a8d8c7400b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:04.828202 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-826603cb-0f97-4229-99c4-09a8d8c7400b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:04.829521 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-826603cb-0f97-4229-99c4-09a8d8c7400b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:04.830344 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-826603cb-0f97-4229-99c4-09a8d8c7400b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:04.830780 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-826603cb-0f97-4229-99c4-09a8d8c7400b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:05.012470 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-826603cb-0f97-4229-99c4-09a8d8c7400b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:05.020264 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-826603cb-0f97-4229-99c4-09a8d8c7400b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.209490 Jun 16 16:14:05.022138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 111/213] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:04 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:05.309115 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7882cbc0-c90f-432b-a4de-a9b47392ef76 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:05.312647 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7882cbc0-c90f-432b-a4de-a9b47392ef76 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:05.324641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7882cbc0-c90f-432b-a4de-a9b47392ef76 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:05.328634 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7882cbc0-c90f-432b-a4de-a9b47392ef76 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:05.330364 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7882cbc0-c90f-432b-a4de-a9b47392ef76 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:05.331179 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7882cbc0-c90f-432b-a4de-a9b47392ef76 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:05.577547 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7882cbc0-c90f-432b-a4de-a9b47392ef76 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:05.592715 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7882cbc0-c90f-432b-a4de-a9b47392ef76 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.287937 Jun 16 16:14:05.593317 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 103/214] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:05 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:06.039294 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0938d91f-9b78-4ac8-bea9-3d3eb98143d8 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:06.040599 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0938d91f-9b78-4ac8-bea9-3d3eb98143d8 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:06.047121 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0938d91f-9b78-4ac8-bea9-3d3eb98143d8 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:06.047673 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0938d91f-9b78-4ac8-bea9-3d3eb98143d8 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:06.048454 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0938d91f-9b78-4ac8-bea9-3d3eb98143d8 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:06.048889 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0938d91f-9b78-4ac8-bea9-3d3eb98143d8 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:06.237360 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0938d91f-9b78-4ac8-bea9-3d3eb98143d8 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:06.246167 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0938d91f-9b78-4ac8-bea9-3d3eb98143d8 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.210656 Jun 16 16:14:06.246860 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 112/215] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:06 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:06.610814 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c9b0a2ce-5f8f-4136-811b-0695ede09658 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:06.611699 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c9b0a2ce-5f8f-4136-811b-0695ede09658 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:06.618889 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c9b0a2ce-5f8f-4136-811b-0695ede09658 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:06.620037 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c9b0a2ce-5f8f-4136-811b-0695ede09658 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:06.620811 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c9b0a2ce-5f8f-4136-811b-0695ede09658 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:06.621495 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c9b0a2ce-5f8f-4136-811b-0695ede09658 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:06.788164 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c9b0a2ce-5f8f-4136-811b-0695ede09658 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:06.797946 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c9b0a2ce-5f8f-4136-811b-0695ede09658 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.190980 Jun 16 16:14:06.803088 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 104/216] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:06 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:07.262841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-85d71556-0ba0-4864-8d94-945ccd2de0f6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:07.263568 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-85d71556-0ba0-4864-8d94-945ccd2de0f6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:07.265571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:07.270923 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-85d71556-0ba0-4864-8d94-945ccd2de0f6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:07.271379 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-85d71556-0ba0-4864-8d94-945ccd2de0f6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:07.272155 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-85d71556-0ba0-4864-8d94-945ccd2de0f6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:07.272589 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-85d71556-0ba0-4864-8d94-945ccd2de0f6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:07.416660 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-85d71556-0ba0-4864-8d94-945ccd2de0f6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:07.424105 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-85d71556-0ba0-4864-8d94-945ccd2de0f6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.165761 Jun 16 16:14:07.424675 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 113/217] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:07 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:07.816096 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6d297420-0686-4b8f-8f04-c750d67a3d7b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:07.816718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6d297420-0686-4b8f-8f04-c750d67a3d7b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:07.819281 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:07.825249 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6d297420-0686-4b8f-8f04-c750d67a3d7b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:07.825700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6d297420-0686-4b8f-8f04-c750d67a3d7b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:07.826498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6d297420-0686-4b8f-8f04-c750d67a3d7b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:07.826933 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6d297420-0686-4b8f-8f04-c750d67a3d7b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:07.991512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6d297420-0686-4b8f-8f04-c750d67a3d7b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:08.004013 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6d297420-0686-4b8f-8f04-c750d67a3d7b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.191661 Jun 16 16:14:08.017811 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 105/218] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:07 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:08.440895 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-44b27d57-af5f-46ce-9ff9-acb087581ef9 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:08.441517 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-44b27d57-af5f-46ce-9ff9-acb087581ef9 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:08.449472 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-44b27d57-af5f-46ce-9ff9-acb087581ef9 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:08.450052 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-44b27d57-af5f-46ce-9ff9-acb087581ef9 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:08.450977 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-44b27d57-af5f-46ce-9ff9-acb087581ef9 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:08.451452 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-44b27d57-af5f-46ce-9ff9-acb087581ef9 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:08.610088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-44b27d57-af5f-46ce-9ff9-acb087581ef9 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:08.617550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-44b27d57-af5f-46ce-9ff9-acb087581ef9 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.180897 Jun 16 16:14:08.618160 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 114/219] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:08 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:09.020965 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1aba19e1-142b-4ca8-aee8-5f29dd1f12ec tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:09.021651 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1aba19e1-142b-4ca8-aee8-5f29dd1f12ec tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:09.029025 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1aba19e1-142b-4ca8-aee8-5f29dd1f12ec tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:09.029478 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1aba19e1-142b-4ca8-aee8-5f29dd1f12ec tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:09.030273 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1aba19e1-142b-4ca8-aee8-5f29dd1f12ec tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:09.030696 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1aba19e1-142b-4ca8-aee8-5f29dd1f12ec tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:09.173528 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1aba19e1-142b-4ca8-aee8-5f29dd1f12ec tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:09.181593 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1aba19e1-142b-4ca8-aee8-5f29dd1f12ec tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.164469 Jun 16 16:14:09.182857 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 106/220] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:09 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:09.634741 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bebbe51d-397a-416d-9f92-6989b9fa775b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:09.635275 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-bebbe51d-397a-416d-9f92-6989b9fa775b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:09.641328 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bebbe51d-397a-416d-9f92-6989b9fa775b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:09.641866 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bebbe51d-397a-416d-9f92-6989b9fa775b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:09.642634 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bebbe51d-397a-416d-9f92-6989b9fa775b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:09.643067 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bebbe51d-397a-416d-9f92-6989b9fa775b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:09.773011 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bebbe51d-397a-416d-9f92-6989b9fa775b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:09.780377 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-bebbe51d-397a-416d-9f92-6989b9fa775b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.149576 Jun 16 16:14:09.780950 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 115/221] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:09 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:10.199710 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-68658abf-923e-4b8a-8c34-eaa78edac47f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:10.200361 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-68658abf-923e-4b8a-8c34-eaa78edac47f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:10.206877 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-68658abf-923e-4b8a-8c34-eaa78edac47f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:10.207325 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-68658abf-923e-4b8a-8c34-eaa78edac47f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:10.208083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-68658abf-923e-4b8a-8c34-eaa78edac47f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:10.208521 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-68658abf-923e-4b8a-8c34-eaa78edac47f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:10.339507 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-68658abf-923e-4b8a-8c34-eaa78edac47f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:10.347211 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-68658abf-923e-4b8a-8c34-eaa78edac47f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.151687 Jun 16 16:14:10.347779 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 107/222] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:10 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:10.798949 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6c84715a-93c8-4ea2-a694-6652d573a490 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:10.799651 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6c84715a-93c8-4ea2-a694-6652d573a490 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:10.805849 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6c84715a-93c8-4ea2-a694-6652d573a490 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:10.806295 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6c84715a-93c8-4ea2-a694-6652d573a490 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:10.807057 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6c84715a-93c8-4ea2-a694-6652d573a490 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:10.807486 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6c84715a-93c8-4ea2-a694-6652d573a490 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:10.811340 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=100 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:10.934932 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6c84715a-93c8-4ea2-a694-6652d573a490 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:10.942309 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6c84715a-93c8-4ea2-a694-6652d573a490 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.147292 Jun 16 16:14:10.942882 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 116/223] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:10 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:11.364921 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e2b8499b-fbef-4740-a9f5-e31fb2cc356c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:11.365648 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e2b8499b-fbef-4740-a9f5-e31fb2cc356c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:11.372816 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e2b8499b-fbef-4740-a9f5-e31fb2cc356c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:11.373343 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e2b8499b-fbef-4740-a9f5-e31fb2cc356c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:11.374230 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e2b8499b-fbef-4740-a9f5-e31fb2cc356c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:11.374738 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e2b8499b-fbef-4740-a9f5-e31fb2cc356c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:11.515243 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e2b8499b-fbef-4740-a9f5-e31fb2cc356c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:11.522720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e2b8499b-fbef-4740-a9f5-e31fb2cc356c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.161729 Jun 16 16:14:11.523354 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 108/224] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:11 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:11.958605 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-97465f61-6417-4d24-ae60-b9ddf6dcd1f7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:11.959487 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-97465f61-6417-4d24-ae60-b9ddf6dcd1f7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:11.961146 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=6 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:11.966877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-97465f61-6417-4d24-ae60-b9ddf6dcd1f7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:11.967326 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-97465f61-6417-4d24-ae60-b9ddf6dcd1f7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:11.968168 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-97465f61-6417-4d24-ae60-b9ddf6dcd1f7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:11.968607 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-97465f61-6417-4d24-ae60-b9ddf6dcd1f7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:12.120464 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-97465f61-6417-4d24-ae60-b9ddf6dcd1f7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:12.143531 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-97465f61-6417-4d24-ae60-b9ddf6dcd1f7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.175302 Jun 16 16:14:12.155519 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 117/225] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:11 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:12.539957 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a94120ce-0a91-44b3-9bf4-a60fb9c8b05e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:12.540577 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a94120ce-0a91-44b3-9bf4-a60fb9c8b05e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:12.548377 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a94120ce-0a91-44b3-9bf4-a60fb9c8b05e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:12.548935 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a94120ce-0a91-44b3-9bf4-a60fb9c8b05e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:12.549613 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a94120ce-0a91-44b3-9bf4-a60fb9c8b05e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:12.550078 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a94120ce-0a91-44b3-9bf4-a60fb9c8b05e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:12.698545 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a94120ce-0a91-44b3-9bf4-a60fb9c8b05e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:12.707632 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a94120ce-0a91-44b3-9bf4-a60fb9c8b05e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.171447 Jun 16 16:14:12.708265 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 109/226] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:12 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:13.161616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0a21bce0-6d30-4719-b49a-86cbf4c05ac9 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:13.162274 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0a21bce0-6d30-4719-b49a-86cbf4c05ac9 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:13.168912 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0a21bce0-6d30-4719-b49a-86cbf4c05ac9 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:13.169339 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0a21bce0-6d30-4719-b49a-86cbf4c05ac9 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:13.170132 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0a21bce0-6d30-4719-b49a-86cbf4c05ac9 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:13.170568 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0a21bce0-6d30-4719-b49a-86cbf4c05ac9 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:13.302058 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0a21bce0-6d30-4719-b49a-86cbf4c05ac9 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:13.309524 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0a21bce0-6d30-4719-b49a-86cbf4c05ac9 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.151707 Jun 16 16:14:13.310117 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 118/227] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:13 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:13.727076 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ee4dc9e9-eac8-4ae8-b0ff-21e234be2eb2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:13.727689 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ee4dc9e9-eac8-4ae8-b0ff-21e234be2eb2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:13.734291 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ee4dc9e9-eac8-4ae8-b0ff-21e234be2eb2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:13.734736 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ee4dc9e9-eac8-4ae8-b0ff-21e234be2eb2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:13.735503 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ee4dc9e9-eac8-4ae8-b0ff-21e234be2eb2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:13.735937 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ee4dc9e9-eac8-4ae8-b0ff-21e234be2eb2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:13.871882 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ee4dc9e9-eac8-4ae8-b0ff-21e234be2eb2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:13.875307 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:13.880119 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ee4dc9e9-eac8-4ae8-b0ff-21e234be2eb2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.158443 Jun 16 16:14:13.880684 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 110/228] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:13 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:14.327577 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-37842dc0-5711-4fd4-842e-4e758ecb28e0 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:14.336586 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-37842dc0-5711-4fd4-842e-4e758ecb28e0 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:14.336586 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-37842dc0-5711-4fd4-842e-4e758ecb28e0 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:14.336586 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-37842dc0-5711-4fd4-842e-4e758ecb28e0 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:14.336586 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-37842dc0-5711-4fd4-842e-4e758ecb28e0 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:14.337015 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-37842dc0-5711-4fd4-842e-4e758ecb28e0 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:14.493257 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-37842dc0-5711-4fd4-842e-4e758ecb28e0 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:14.501935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-37842dc0-5711-4fd4-842e-4e758ecb28e0 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.179484 Jun 16 16:14:14.503144 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 119/229] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:14 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:14.564662 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-9e98dd00-68dd-4c68-97b4-41e53af1b8a3 req-95eab769-a8a6-439e-9cd8-fb92c1d15106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2fe4ab-2e04-4754-8301-e0c6666f1c61", "name": "network-vif-plugged", "status": "completed", "tag": "3f5a0aae-f27d-4b24-94b2-031c768b687b"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:14.573998 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-9e98dd00-68dd-4c68-97b4-41e53af1b8a3 req-95eab769-a8a6-439e-9cd8-fb92c1d15106 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:14.574509 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-9e98dd00-68dd-4c68-97b4-41e53af1b8a3 req-95eab769-a8a6-439e-9cd8-fb92c1d15106 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:14.588940 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-9e98dd00-68dd-4c68-97b4-41e53af1b8a3 req-95eab769-a8a6-439e-9cd8-fb92c1d15106 service nova] Creating event network-vif-plugged:3f5a0aae-f27d-4b24-94b2-031c768b687b for instance aa2fe4ab-2e04-4754-8301-e0c6666f1c61 on hv-cinder-83735 Jun 16 16:14:14.595095 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-9e98dd00-68dd-4c68-97b4-41e53af1b8a3 req-95eab769-a8a6-439e-9cd8-fb92c1d15106 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035148 Jun 16 16:14:14.595854 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 111/230] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:14.897673 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ce2041e3-8eab-4bab-aece-b7ee4f4080dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:14.898338 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ce2041e3-8eab-4bab-aece-b7ee4f4080dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:14.905594 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ce2041e3-8eab-4bab-aece-b7ee4f4080dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:14.906090 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ce2041e3-8eab-4bab-aece-b7ee4f4080dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:14.906872 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ce2041e3-8eab-4bab-aece-b7ee4f4080dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:14.907318 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ce2041e3-8eab-4bab-aece-b7ee4f4080dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:15.112576 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ce2041e3-8eab-4bab-aece-b7ee4f4080dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:15.122249 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ce2041e3-8eab-4bab-aece-b7ee4f4080dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.228376 Jun 16 16:14:15.123124 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 120/231] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:14 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:15.399373 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a54995f1-87a5-4fb6-8d19-ddb9526f658e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:15.399866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a54995f1-87a5-4fb6-8d19-ddb9526f658e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:15.406093 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a54995f1-87a5-4fb6-8d19-ddb9526f658e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:15.406546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a54995f1-87a5-4fb6-8d19-ddb9526f658e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:15.407306 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a54995f1-87a5-4fb6-8d19-ddb9526f658e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:15.407745 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a54995f1-87a5-4fb6-8d19-ddb9526f658e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:15.432783 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a54995f1-87a5-4fb6-8d19-ddb9526f658e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:14:15.520575 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-05284161-694a-41b4-9e56-e2ba34877709 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:15.521380 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-05284161-694a-41b4-9e56-e2ba34877709 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:15.525123 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a54995f1-87a5-4fb6-8d19-ddb9526f658e tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "DELETE /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 204 len: 0 microversion: 2.1 time: 0.129844 Jun 16 16:14:15.525971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 112/232] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:14:15 2022] DELETE /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:14:15.529301 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05284161-694a-41b4-9e56-e2ba34877709 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:15.529763 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05284161-694a-41b4-9e56-e2ba34877709 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:15.530819 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05284161-694a-41b4-9e56-e2ba34877709 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:15.532301 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05284161-694a-41b4-9e56-e2ba34877709 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:15.535437 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-96273cc4-3da7-4941-b217-d76faff31a58 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:15.536261 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-96273cc4-3da7-4941-b217-d76faff31a58 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:15.546219 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-96273cc4-3da7-4941-b217-d76faff31a58 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:15.546757 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-96273cc4-3da7-4941-b217-d76faff31a58 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:15.547601 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-96273cc4-3da7-4941-b217-d76faff31a58 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:15.548104 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-96273cc4-3da7-4941-b217-d76faff31a58 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:15.755210 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-05284161-694a-41b4-9e56-e2ba34877709 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:15.762407 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-96273cc4-3da7-4941-b217-d76faff31a58 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:15.762961 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-05284161-694a-41b4-9e56-e2ba34877709 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.247254 Jun 16 16:14:15.763704 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 121/233] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:15 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:15.770704 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-96273cc4-3da7-4941-b217-d76faff31a58 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1555 microversion: 2.1 time: 0.239533 Jun 16 16:14:15.771275 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 113/234] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:15 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1555 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:16.139871 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c2a95c93-2a68-4e2d-b981-21e0432c2fae tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:16.140724 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c2a95c93-2a68-4e2d-b981-21e0432c2fae tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:16.147145 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c2a95c93-2a68-4e2d-b981-21e0432c2fae tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:16.147585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c2a95c93-2a68-4e2d-b981-21e0432c2fae tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:16.148339 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c2a95c93-2a68-4e2d-b981-21e0432c2fae tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:16.148775 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c2a95c93-2a68-4e2d-b981-21e0432c2fae tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:16.284931 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c2a95c93-2a68-4e2d-b981-21e0432c2fae tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:16.293015 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c2a95c93-2a68-4e2d-b981-21e0432c2fae tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.157661 Jun 16 16:14:16.293580 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 122/235] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:16 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:16.779093 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8a1d5941-ea19-4aa7-93c3-efad09bd868a tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:16.779704 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8a1d5941-ea19-4aa7-93c3-efad09bd868a tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:16.786320 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8a1d5941-ea19-4aa7-93c3-efad09bd868a tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:16.786771 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8a1d5941-ea19-4aa7-93c3-efad09bd868a tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:16.787535 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8a1d5941-ea19-4aa7-93c3-efad09bd868a tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:16.787645 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7dc31aaf-35a9-4237-b22f-c5e7c8868ea5 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:16.788052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8a1d5941-ea19-4aa7-93c3-efad09bd868a tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:16.788209 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7dc31aaf-35a9-4237-b22f-c5e7c8868ea5 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:16.794136 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7dc31aaf-35a9-4237-b22f-c5e7c8868ea5 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:16.794585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7dc31aaf-35a9-4237-b22f-c5e7c8868ea5 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:16.795347 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7dc31aaf-35a9-4237-b22f-c5e7c8868ea5 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:16.795784 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7dc31aaf-35a9-4237-b22f-c5e7c8868ea5 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:16.988562 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7dc31aaf-35a9-4237-b22f-c5e7c8868ea5 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:16.992269 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8a1d5941-ea19-4aa7-93c3-efad09bd868a tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:16.997998 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7dc31aaf-35a9-4237-b22f-c5e7c8868ea5 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1555 microversion: 2.1 time: 0.213979 Jun 16 16:14:16.998896 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 123/236] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:16 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1555 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:17.006749 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8a1d5941-ea19-4aa7-93c3-efad09bd868a tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.231364 Jun 16 16:14:17.007355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 114/237] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:16 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:17.310341 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8caef807-c2ea-414b-b4d6-5df0c702ad13 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:17.310956 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8caef807-c2ea-414b-b4d6-5df0c702ad13 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:17.316938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8caef807-c2ea-414b-b4d6-5df0c702ad13 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:17.317401 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8caef807-c2ea-414b-b4d6-5df0c702ad13 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:17.318210 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8caef807-c2ea-414b-b4d6-5df0c702ad13 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:17.318652 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8caef807-c2ea-414b-b4d6-5df0c702ad13 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:17.450424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8caef807-c2ea-414b-b4d6-5df0c702ad13 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:17.467824 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8caef807-c2ea-414b-b4d6-5df0c702ad13 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.161722 Jun 16 16:14:17.468649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 124/238] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:17 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:18.014151 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-98387487-d2a7-49f4-ae7c-269fe2255ac3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:18.014792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-98387487-d2a7-49f4-ae7c-269fe2255ac3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:18.021354 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-98387487-d2a7-49f4-ae7c-269fe2255ac3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:18.021828 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-98387487-d2a7-49f4-ae7c-269fe2255ac3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:18.022595 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-98387487-d2a7-49f4-ae7c-269fe2255ac3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:18.023031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-98387487-d2a7-49f4-ae7c-269fe2255ac3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:18.023889 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-08237770-aaaa-48d5-8705-0a714ee79936 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:18.024507 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-08237770-aaaa-48d5-8705-0a714ee79936 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:18.030524 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-08237770-aaaa-48d5-8705-0a714ee79936 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:18.030976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-08237770-aaaa-48d5-8705-0a714ee79936 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:18.031745 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-08237770-aaaa-48d5-8705-0a714ee79936 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:18.032187 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-08237770-aaaa-48d5-8705-0a714ee79936 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:18.227902 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-98387487-d2a7-49f4-ae7c-269fe2255ac3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:18.235751 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-08237770-aaaa-48d5-8705-0a714ee79936 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:18.236696 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-98387487-d2a7-49f4-ae7c-269fe2255ac3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1555 microversion: 2.1 time: 0.226269 Jun 16 16:14:18.237274 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 115/239] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:18 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:18.243981 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-08237770-aaaa-48d5-8705-0a714ee79936 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.224057 Jun 16 16:14:18.244563 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 125/240] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:18 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:18.485041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f8f78e08-cfd5-45f5-8b36-bc042568d3d6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:18.485609 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f8f78e08-cfd5-45f5-8b36-bc042568d3d6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:18.491765 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f8f78e08-cfd5-45f5-8b36-bc042568d3d6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:18.492207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f8f78e08-cfd5-45f5-8b36-bc042568d3d6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:18.492904 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f8f78e08-cfd5-45f5-8b36-bc042568d3d6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:18.493342 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f8f78e08-cfd5-45f5-8b36-bc042568d3d6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:18.631165 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f8f78e08-cfd5-45f5-8b36-bc042568d3d6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:18.638640 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f8f78e08-cfd5-45f5-8b36-bc042568d3d6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.157528 Jun 16 16:14:18.639204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 116/241] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:18 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:19.254213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cd9ae4d6-bb2c-48cb-91f7-564ce6eff164 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:19.254946 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-cd9ae4d6-bb2c-48cb-91f7-564ce6eff164 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:19.260192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-00a712f0-4ef3-4c5a-af3a-bbf3f5edcadd tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:19.260830 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-00a712f0-4ef3-4c5a-af3a-bbf3f5edcadd tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:19.260933 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cd9ae4d6-bb2c-48cb-91f7-564ce6eff164 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:19.261354 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cd9ae4d6-bb2c-48cb-91f7-564ce6eff164 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:19.262202 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cd9ae4d6-bb2c-48cb-91f7-564ce6eff164 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:19.262571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cd9ae4d6-bb2c-48cb-91f7-564ce6eff164 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:19.267384 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-00a712f0-4ef3-4c5a-af3a-bbf3f5edcadd tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:19.267830 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-00a712f0-4ef3-4c5a-af3a-bbf3f5edcadd tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:19.268731 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-00a712f0-4ef3-4c5a-af3a-bbf3f5edcadd tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:19.269338 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-00a712f0-4ef3-4c5a-af3a-bbf3f5edcadd tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:19.457065 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cd9ae4d6-bb2c-48cb-91f7-564ce6eff164 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:19.465156 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-00a712f0-4ef3-4c5a-af3a-bbf3f5edcadd tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:19.466021 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cd9ae4d6-bb2c-48cb-91f7-564ce6eff164 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1555 microversion: 2.1 time: 0.215671 Jun 16 16:14:19.466683 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 126/242] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:19 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1555 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:19.472924 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-00a712f0-4ef3-4c5a-af3a-bbf3f5edcadd tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.216585 Jun 16 16:14:19.473476 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 117/243] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:19 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:19.655918 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f1b76012-9e59-41ea-8b40-ad333467ca01 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:19.656524 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f1b76012-9e59-41ea-8b40-ad333467ca01 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:19.662592 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f1b76012-9e59-41ea-8b40-ad333467ca01 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:19.663038 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f1b76012-9e59-41ea-8b40-ad333467ca01 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:19.663787 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f1b76012-9e59-41ea-8b40-ad333467ca01 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:19.664222 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f1b76012-9e59-41ea-8b40-ad333467ca01 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:19.794810 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f1b76012-9e59-41ea-8b40-ad333467ca01 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:19.802262 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f1b76012-9e59-41ea-8b40-ad333467ca01 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.150159 Jun 16 16:14:19.802826 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 127/244] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:19 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:20.485866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b9f11340-38fa-4f8b-8c5b-0393439b916d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:20.486502 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b9f11340-38fa-4f8b-8c5b-0393439b916d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:20.490310 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d9545ccb-ca6a-4d48-9a1f-cd5be9c1b1d7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:20.490925 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d9545ccb-ca6a-4d48-9a1f-cd5be9c1b1d7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:20.493613 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b9f11340-38fa-4f8b-8c5b-0393439b916d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:20.494593 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b9f11340-38fa-4f8b-8c5b-0393439b916d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:20.495371 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b9f11340-38fa-4f8b-8c5b-0393439b916d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:20.495863 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b9f11340-38fa-4f8b-8c5b-0393439b916d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:20.498148 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d9545ccb-ca6a-4d48-9a1f-cd5be9c1b1d7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:20.498599 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d9545ccb-ca6a-4d48-9a1f-cd5be9c1b1d7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:20.499363 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d9545ccb-ca6a-4d48-9a1f-cd5be9c1b1d7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:20.499798 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d9545ccb-ca6a-4d48-9a1f-cd5be9c1b1d7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:20.700893 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b9f11340-38fa-4f8b-8c5b-0393439b916d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:20.704988 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d9545ccb-ca6a-4d48-9a1f-cd5be9c1b1d7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:20.712689 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d9545ccb-ca6a-4d48-9a1f-cd5be9c1b1d7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.226247 Jun 16 16:14:20.713256 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 128/245] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:20 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:20.717552 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b9f11340-38fa-4f8b-8c5b-0393439b916d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1555 microversion: 2.1 time: 0.237691 Jun 16 16:14:20.718179 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 118/246] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:20 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1555 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:20.819574 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6235dcec-a016-4d1c-8d70-b89b186de8af tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:20.820171 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6235dcec-a016-4d1c-8d70-b89b186de8af tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:20.827087 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6235dcec-a016-4d1c-8d70-b89b186de8af tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:20.827533 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6235dcec-a016-4d1c-8d70-b89b186de8af tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:20.828277 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6235dcec-a016-4d1c-8d70-b89b186de8af tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:20.828705 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6235dcec-a016-4d1c-8d70-b89b186de8af tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:20.960065 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6235dcec-a016-4d1c-8d70-b89b186de8af tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:20.967545 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6235dcec-a016-4d1c-8d70-b89b186de8af tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.151802 Jun 16 16:14:20.968112 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 129/247] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:20 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:21.730548 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8b2c8b4b-0878-4b4a-936f-cb46e82704cb tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:21.731160 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8b2c8b4b-0878-4b4a-936f-cb46e82704cb tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:21.734677 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7378cda7-eebc-4a03-921d-bcadac23a8b8 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:21.735287 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7378cda7-eebc-4a03-921d-bcadac23a8b8 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:21.738628 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8b2c8b4b-0878-4b4a-936f-cb46e82704cb tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:21.739092 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8b2c8b4b-0878-4b4a-936f-cb46e82704cb tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:21.740315 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8b2c8b4b-0878-4b4a-936f-cb46e82704cb tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:21.740760 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8b2c8b4b-0878-4b4a-936f-cb46e82704cb tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:21.742664 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7378cda7-eebc-4a03-921d-bcadac23a8b8 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:21.743110 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7378cda7-eebc-4a03-921d-bcadac23a8b8 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:21.744422 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7378cda7-eebc-4a03-921d-bcadac23a8b8 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:21.744856 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7378cda7-eebc-4a03-921d-bcadac23a8b8 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:21.939363 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7378cda7-eebc-4a03-921d-bcadac23a8b8 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:21.947296 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8b2c8b4b-0878-4b4a-936f-cb46e82704cb tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:21.950248 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7378cda7-eebc-4a03-921d-bcadac23a8b8 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1555 microversion: 2.1 time: 0.219203 Jun 16 16:14:21.951018 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 130/248] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:21 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1555 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:21.954968 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8b2c8b4b-0878-4b4a-936f-cb46e82704cb tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.228796 Jun 16 16:14:21.955524 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 119/249] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:21 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:21.984740 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ebd852e9-7be4-48a5-8ac7-04b553fce055 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:21.985377 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ebd852e9-7be4-48a5-8ac7-04b553fce055 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:21.991593 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ebd852e9-7be4-48a5-8ac7-04b553fce055 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:21.992115 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ebd852e9-7be4-48a5-8ac7-04b553fce055 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:21.992796 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ebd852e9-7be4-48a5-8ac7-04b553fce055 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:21.993227 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ebd852e9-7be4-48a5-8ac7-04b553fce055 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:22.314335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ebd852e9-7be4-48a5-8ac7-04b553fce055 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:22.322598 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ebd852e9-7be4-48a5-8ac7-04b553fce055 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.341060 Jun 16 16:14:22.323196 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 131/250] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:21 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:22.967686 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ac7dfc22-2f71-405a-af70-5a294fcbbf45 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:22.968300 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ac7dfc22-2f71-405a-af70-5a294fcbbf45 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:22.972310 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bd019ccc-c13c-4be1-a285-63c49c77ed42 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:22.972926 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-bd019ccc-c13c-4be1-a285-63c49c77ed42 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:22.975537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ac7dfc22-2f71-405a-af70-5a294fcbbf45 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:22.976274 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ac7dfc22-2f71-405a-af70-5a294fcbbf45 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:22.976739 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ac7dfc22-2f71-405a-af70-5a294fcbbf45 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:22.977166 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ac7dfc22-2f71-405a-af70-5a294fcbbf45 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:22.979398 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bd019ccc-c13c-4be1-a285-63c49c77ed42 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:22.979849 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bd019ccc-c13c-4be1-a285-63c49c77ed42 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:22.980620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bd019ccc-c13c-4be1-a285-63c49c77ed42 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:22.981057 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bd019ccc-c13c-4be1-a285-63c49c77ed42 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:23.177197 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bd019ccc-c13c-4be1-a285-63c49c77ed42 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:23.180894 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=100 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:23.182029 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ac7dfc22-2f71-405a-af70-5a294fcbbf45 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:23.186335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-bd019ccc-c13c-4be1-a285-63c49c77ed42 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.218245 Jun 16 16:14:23.186914 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 132/251] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:22 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:23.190473 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ac7dfc22-2f71-405a-af70-5a294fcbbf45 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1555 microversion: 2.1 time: 0.226720 Jun 16 16:14:23.191058 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 120/252] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:22 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1555 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:23.340802 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-803b7fb8-5b1a-4c0e-a41f-f978fe50cc3d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:23.341555 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-803b7fb8-5b1a-4c0e-a41f-f978fe50cc3d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:23.348776 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-803b7fb8-5b1a-4c0e-a41f-f978fe50cc3d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:23.349306 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-803b7fb8-5b1a-4c0e-a41f-f978fe50cc3d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:23.350361 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-803b7fb8-5b1a-4c0e-a41f-f978fe50cc3d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:23.351163 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-803b7fb8-5b1a-4c0e-a41f-f978fe50cc3d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:23.505940 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-803b7fb8-5b1a-4c0e-a41f-f978fe50cc3d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:23.513529 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-803b7fb8-5b1a-4c0e-a41f-f978fe50cc3d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.177974 Jun 16 16:14:23.517964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 133/253] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:23 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:24.205703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8b446ebc-8be4-45aa-b56e-207fb91740f0 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:24.206995 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8b446ebc-8be4-45aa-b56e-207fb91740f0 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:24.208707 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-896bd4ed-02af-46b4-85ce-c358e4751fe9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:24.209423 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-896bd4ed-02af-46b4-85ce-c358e4751fe9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:24.215395 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8b446ebc-8be4-45aa-b56e-207fb91740f0 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:24.215751 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-896bd4ed-02af-46b4-85ce-c358e4751fe9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:24.216316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-896bd4ed-02af-46b4-85ce-c358e4751fe9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:24.216653 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8b446ebc-8be4-45aa-b56e-207fb91740f0 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:24.217388 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-896bd4ed-02af-46b4-85ce-c358e4751fe9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:24.217712 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8b446ebc-8be4-45aa-b56e-207fb91740f0 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:24.217927 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-896bd4ed-02af-46b4-85ce-c358e4751fe9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:24.218222 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8b446ebc-8be4-45aa-b56e-207fb91740f0 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:24.435753 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-896bd4ed-02af-46b4-85ce-c358e4751fe9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:24.446239 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8b446ebc-8be4-45aa-b56e-207fb91740f0 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:24.446407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-896bd4ed-02af-46b4-85ce-c358e4751fe9 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1555 microversion: 2.1 time: 0.241336 Jun 16 16:14:24.447504 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 134/254] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:24 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1555 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:24.458960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8b446ebc-8be4-45aa-b56e-207fb91740f0 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.256477 Jun 16 16:14:24.459626 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 121/255] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:24 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:24.529493 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-eb1fb446-2c29-48d7-8b31-7f440a602ce0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:24.530158 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-eb1fb446-2c29-48d7-8b31-7f440a602ce0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:24.536461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb1fb446-2c29-48d7-8b31-7f440a602ce0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:24.536982 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb1fb446-2c29-48d7-8b31-7f440a602ce0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:24.537846 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb1fb446-2c29-48d7-8b31-7f440a602ce0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:24.538415 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb1fb446-2c29-48d7-8b31-7f440a602ce0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:24.680937 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-eb1fb446-2c29-48d7-8b31-7f440a602ce0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:24.688480 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-eb1fb446-2c29-48d7-8b31-7f440a602ce0 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.162894 Jun 16 16:14:24.689051 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 135/256] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:24 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:25.466398 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d1fe10ec-90b9-4577-a864-25a65dfab571 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:25.467663 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d1fe10ec-90b9-4577-a864-25a65dfab571 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:25.475846 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d1fe10ec-90b9-4577-a864-25a65dfab571 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:25.476312 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d1fe10ec-90b9-4577-a864-25a65dfab571 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:25.477224 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d1fe10ec-90b9-4577-a864-25a65dfab571 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:25.477304 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e3c47303-64d7-48e2-addb-0cb5c746d7c2 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:25.477780 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d1fe10ec-90b9-4577-a864-25a65dfab571 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:25.478181 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e3c47303-64d7-48e2-addb-0cb5c746d7c2 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:25.486333 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e3c47303-64d7-48e2-addb-0cb5c746d7c2 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:25.486785 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e3c47303-64d7-48e2-addb-0cb5c746d7c2 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:25.487552 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e3c47303-64d7-48e2-addb-0cb5c746d7c2 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:25.488270 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e3c47303-64d7-48e2-addb-0cb5c746d7c2 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:25.680046 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d1fe10ec-90b9-4577-a864-25a65dfab571 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:25.691505 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e3c47303-64d7-48e2-addb-0cb5c746d7c2 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:25.692734 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d1fe10ec-90b9-4577-a864-25a65dfab571 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1555 microversion: 2.1 time: 0.230655 Jun 16 16:14:25.693049 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 122/257] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:25 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1555 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:25.702187 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e3c47303-64d7-48e2-addb-0cb5c746d7c2 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.229925 Jun 16 16:14:25.704523 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 136/258] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:25 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:25.708485 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1d04f3fd-d3ec-44bb-99cc-a8af42edd6b2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:25.709824 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1d04f3fd-d3ec-44bb-99cc-a8af42edd6b2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:25.717752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1d04f3fd-d3ec-44bb-99cc-a8af42edd6b2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:25.718324 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1d04f3fd-d3ec-44bb-99cc-a8af42edd6b2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:25.719273 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1d04f3fd-d3ec-44bb-99cc-a8af42edd6b2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:25.719891 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1d04f3fd-d3ec-44bb-99cc-a8af42edd6b2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:25.859175 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1d04f3fd-d3ec-44bb-99cc-a8af42edd6b2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:25.868272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1d04f3fd-d3ec-44bb-99cc-a8af42edd6b2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.166012 Jun 16 16:14:25.870003 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 123/259] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:25 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:26.710701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-680e002e-5d62-439d-9c8f-a4cf63b3fc5f tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:26.711422 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-680e002e-5d62-439d-9c8f-a4cf63b3fc5f tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:26.722423 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0bfe5ef7-a459-4065-be4a-39f2f3e114ac tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:26.723150 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0bfe5ef7-a459-4065-be4a-39f2f3e114ac tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:26.730671 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0bfe5ef7-a459-4065-be4a-39f2f3e114ac tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:26.731119 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0bfe5ef7-a459-4065-be4a-39f2f3e114ac tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:26.731899 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0bfe5ef7-a459-4065-be4a-39f2f3e114ac tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:26.732334 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0bfe5ef7-a459-4065-be4a-39f2f3e114ac tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:26.733819 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-680e002e-5d62-439d-9c8f-a4cf63b3fc5f tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:26.734277 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-680e002e-5d62-439d-9c8f-a4cf63b3fc5f tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:26.735064 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-680e002e-5d62-439d-9c8f-a4cf63b3fc5f tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:26.735502 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-680e002e-5d62-439d-9c8f-a4cf63b3fc5f tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:26.995914 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0bfe5ef7-a459-4065-be4a-39f2f3e114ac tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:27.001192 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-680e002e-5d62-439d-9c8f-a4cf63b3fc5f tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:27.012701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-680e002e-5d62-439d-9c8f-a4cf63b3fc5f tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1555 microversion: 2.1 time: 0.306107 Jun 16 16:14:27.013115 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0bfe5ef7-a459-4065-be4a-39f2f3e114ac tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.295046 Jun 16 16:14:27.013279 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 137/260] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:26 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1555 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:27.018514 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2739f14a-da61-4d6a-b2f8-511488e6ea7b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:27.019335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2739f14a-da61-4d6a-b2f8-511488e6ea7b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:27.027101 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2739f14a-da61-4d6a-b2f8-511488e6ea7b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:27.027663 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2739f14a-da61-4d6a-b2f8-511488e6ea7b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:27.028445 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2739f14a-da61-4d6a-b2f8-511488e6ea7b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:27.028907 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2739f14a-da61-4d6a-b2f8-511488e6ea7b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:27.032792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 124/261] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:26 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:27.180316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2739f14a-da61-4d6a-b2f8-511488e6ea7b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:27.188460 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2739f14a-da61-4d6a-b2f8-511488e6ea7b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.173818 Jun 16 16:14:27.189056 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 138/262] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:27 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:28.044266 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-dff72d61-80e2-4dee-941d-b7f678799a4d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:28.048369 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3050141d-3b45-41d9-b37b-471394e61ad8 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:28.049880 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-dff72d61-80e2-4dee-941d-b7f678799a4d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:28.051743 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3050141d-3b45-41d9-b37b-471394e61ad8 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:28.071437 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dff72d61-80e2-4dee-941d-b7f678799a4d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:28.073804 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3050141d-3b45-41d9-b37b-471394e61ad8 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:28.074347 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3050141d-3b45-41d9-b37b-471394e61ad8 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:28.075268 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dff72d61-80e2-4dee-941d-b7f678799a4d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:28.075952 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3050141d-3b45-41d9-b37b-471394e61ad8 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:28.076348 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3050141d-3b45-41d9-b37b-471394e61ad8 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:28.079975 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dff72d61-80e2-4dee-941d-b7f678799a4d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:28.080425 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dff72d61-80e2-4dee-941d-b7f678799a4d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:28.355289 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-dff72d61-80e2-4dee-941d-b7f678799a4d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:28.363672 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3050141d-3b45-41d9-b37b-471394e61ad8 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:28.371827 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3050141d-3b45-41d9-b37b-471394e61ad8 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1319 microversion: 2.1 time: 0.345067 Jun 16 16:14:28.372501 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 125/263] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:28 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:28.373485 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-dff72d61-80e2-4dee-941d-b7f678799a4d tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1555 microversion: 2.1 time: 0.344598 Jun 16 16:14:28.377079 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e410b2af-0bd1-44ff-aaee-6d10d6ab698d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:28.377954 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e410b2af-0bd1-44ff-aaee-6d10d6ab698d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:28.385910 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 139/264] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:28 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1555 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:28.390186 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e410b2af-0bd1-44ff-aaee-6d10d6ab698d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:28.390546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e410b2af-0bd1-44ff-aaee-6d10d6ab698d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:28.391424 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e410b2af-0bd1-44ff-aaee-6d10d6ab698d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:28.391936 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e410b2af-0bd1-44ff-aaee-6d10d6ab698d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:28.412440 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:28.555076 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e410b2af-0bd1-44ff-aaee-6d10d6ab698d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:28.565431 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e410b2af-0bd1-44ff-aaee-6d10d6ab698d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.191881 Jun 16 16:14:28.566152 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 126/265] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:28 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:29.396068 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7484efee-e6a5-41bf-a8c5-cede87b50273 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:29.396926 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7484efee-e6a5-41bf-a8c5-cede87b50273 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:29.408924 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7484efee-e6a5-41bf-a8c5-cede87b50273 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:29.409805 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0d108957-d5e9-4568-9524-017cf624fc39 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:29.410433 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7484efee-e6a5-41bf-a8c5-cede87b50273 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:29.410844 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0d108957-d5e9-4568-9524-017cf624fc39 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:29.411298 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7484efee-e6a5-41bf-a8c5-cede87b50273 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:29.412255 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7484efee-e6a5-41bf-a8c5-cede87b50273 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:29.438796 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0d108957-d5e9-4568-9524-017cf624fc39 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:29.439581 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0d108957-d5e9-4568-9524-017cf624fc39 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:29.440884 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0d108957-d5e9-4568-9524-017cf624fc39 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:29.441629 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0d108957-d5e9-4568-9524-017cf624fc39 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:29.823410 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7484efee-e6a5-41bf-a8c5-cede87b50273 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:29.826577 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0d108957-d5e9-4568-9524-017cf624fc39 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:29.832010 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7484efee-e6a5-41bf-a8c5-cede87b50273 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1555 microversion: 2.1 time: 0.443864 Jun 16 16:14:29.832600 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 127/266] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:29 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1555 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:29.841735 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0d108957-d5e9-4568-9524-017cf624fc39 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1507 microversion: 2.1 time: 0.450880 Jun 16 16:14:29.841735 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 140/267] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:29 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1507 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:29.842274 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-41e5e19b-de87-4c9e-b8a1-6e6e90e6fdb8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:29.842525 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-41e5e19b-de87-4c9e-b8a1-6e6e90e6fdb8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:29.856316 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-41e5e19b-de87-4c9e-b8a1-6e6e90e6fdb8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:29.856827 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-41e5e19b-de87-4c9e-b8a1-6e6e90e6fdb8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:29.857641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-41e5e19b-de87-4c9e-b8a1-6e6e90e6fdb8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:29.858110 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-41e5e19b-de87-4c9e-b8a1-6e6e90e6fdb8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:30.104099 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-41e5e19b-de87-4c9e-b8a1-6e6e90e6fdb8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:30.112187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-41e5e19b-de87-4c9e-b8a1-6e6e90e6fdb8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1522 microversion: 2.1 time: 0.278486 Jun 16 16:14:30.113116 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 128/268] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:29 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:30.337213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-a307a015-eb71-4e7a-9aba-d0f5ad5486cf req-f25666ae-3d4f-40d3-a5ce-abd42a0c3f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79a464c4-3b6c-48f2-b733-8970ccf82e0d", "name": "network-vif-deleted", "tag": "17ff1249-a9c6-473b-9c9c-1c74c01a15cc"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:30.354879 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-a307a015-eb71-4e7a-9aba-d0f5ad5486cf req-f25666ae-3d4f-40d3-a5ce-abd42a0c3f55 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:30.355611 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-a307a015-eb71-4e7a-9aba-d0f5ad5486cf req-f25666ae-3d4f-40d3-a5ce-abd42a0c3f55 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:30.395224 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-a307a015-eb71-4e7a-9aba-d0f5ad5486cf req-f25666ae-3d4f-40d3-a5ce-abd42a0c3f55 service nova] Creating event network-vif-deleted:17ff1249-a9c6-473b-9c9c-1c74c01a15cc for instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d on hv-cinder-83735 Jun 16 16:14:30.402454 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-a307a015-eb71-4e7a-9aba-d0f5ad5486cf req-f25666ae-3d4f-40d3-a5ce-abd42a0c3f55 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071199 Jun 16 16:14:30.403047 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 141/269] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:30.850708 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c76c76a7-0bcd-416f-93d2-ce67bb63cedd tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:30.851354 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c76c76a7-0bcd-416f-93d2-ce67bb63cedd tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:30.857813 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c76c76a7-0bcd-416f-93d2-ce67bb63cedd tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:30.858262 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c76c76a7-0bcd-416f-93d2-ce67bb63cedd tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:30.859136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c76c76a7-0bcd-416f-93d2-ce67bb63cedd tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:30.859570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c76c76a7-0bcd-416f-93d2-ce67bb63cedd tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:30.924706 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c76c76a7-0bcd-416f-93d2-ce67bb63cedd tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:30.932993 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c76c76a7-0bcd-416f-93d2-ce67bb63cedd tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1346 microversion: 2.1 time: 0.086617 Jun 16 16:14:30.933849 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 129/270] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:30 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:31.129958 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f11567ae-7207-4ff4-9963-fda9d9f179a7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:31.130708 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f11567ae-7207-4ff4-9963-fda9d9f179a7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:31.138136 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f11567ae-7207-4ff4-9963-fda9d9f179a7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:31.138580 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f11567ae-7207-4ff4-9963-fda9d9f179a7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:31.139343 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f11567ae-7207-4ff4-9963-fda9d9f179a7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:31.139767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f11567ae-7207-4ff4-9963-fda9d9f179a7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:31.276533 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f11567ae-7207-4ff4-9963-fda9d9f179a7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:31.284149 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f11567ae-7207-4ff4-9963-fda9d9f179a7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1502 microversion: 2.1 time: 0.158504 Jun 16 16:14:31.284751 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 142/271] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:31 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:31.299711 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c9ded755-8832-4b71-95a1-b4e3a2b5a674 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:31.300323 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c9ded755-8832-4b71-95a1-b4e3a2b5a674 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:31.306833 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c9ded755-8832-4b71-95a1-b4e3a2b5a674 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:31.307278 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c9ded755-8832-4b71-95a1-b4e3a2b5a674 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:31.308039 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c9ded755-8832-4b71-95a1-b4e3a2b5a674 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:31.308474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c9ded755-8832-4b71-95a1-b4e3a2b5a674 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:31.436904 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c9ded755-8832-4b71-95a1-b4e3a2b5a674 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:31.446846 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c9ded755-8832-4b71-95a1-b4e3a2b5a674 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1517 microversion: 2.1 time: 0.150761 Jun 16 16:14:31.447605 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 130/272] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:31 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:31.951381 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b6ea2470-6a7b-449e-a5c7-ed4b5775ae45 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:31.952391 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b6ea2470-6a7b-449e-a5c7-ed4b5775ae45 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:31.962388 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b6ea2470-6a7b-449e-a5c7-ed4b5775ae45 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:31.963081 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b6ea2470-6a7b-449e-a5c7-ed4b5775ae45 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:31.964258 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b6ea2470-6a7b-449e-a5c7-ed4b5775ae45 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:31.964704 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b6ea2470-6a7b-449e-a5c7-ed4b5775ae45 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:32.212847 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b6ea2470-6a7b-449e-a5c7-ed4b5775ae45 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:32.220927 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b6ea2470-6a7b-449e-a5c7-ed4b5775ae45 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1346 microversion: 2.1 time: 0.274419 Jun 16 16:14:32.221507 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 143/273] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:31 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1346 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:33.238003 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6382d3c7-5c10-41fb-8e22-25bbc5488328 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:33.238634 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6382d3c7-5c10-41fb-8e22-25bbc5488328 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:33.246396 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6382d3c7-5c10-41fb-8e22-25bbc5488328 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:33.246843 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6382d3c7-5c10-41fb-8e22-25bbc5488328 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:33.247657 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6382d3c7-5c10-41fb-8e22-25bbc5488328 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:33.248087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6382d3c7-5c10-41fb-8e22-25bbc5488328 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:33.280517 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6382d3c7-5c10-41fb-8e22-25bbc5488328 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:33.280959 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6382d3c7-5c10-41fb-8e22-25bbc5488328 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:33.281397 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-6382d3c7-5c10-41fb-8e22-25bbc5488328 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lazy-loading 'fault' on Instance uuid 79a464c4-3b6c-48f2-b733-8970ccf82e0d {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:14:33.330311 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6382d3c7-5c10-41fb-8e22-25bbc5488328 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:33.338524 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6382d3c7-5c10-41fb-8e22-25bbc5488328 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1351 microversion: 2.1 time: 0.104369 Jun 16 16:14:33.339093 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 131/274] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:33 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:33.901796 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-10050a9f-110e-424f-aeca-aa485f7418e9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:33.902813 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-10050a9f-110e-424f-aeca-aa485f7418e9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:33.909086 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10050a9f-110e-424f-aeca-aa485f7418e9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:33.909752 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10050a9f-110e-424f-aeca-aa485f7418e9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:33.910645 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10050a9f-110e-424f-aeca-aa485f7418e9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:33.911078 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10050a9f-110e-424f-aeca-aa485f7418e9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:34.074850 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-10050a9f-110e-424f-aeca-aa485f7418e9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lazy-loading 'flavor' on Instance uuid 7c1389bc-ae98-44d1-943a-669b44dde9ad {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:14:34.194809 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-10050a9f-110e-424f-aeca-aa485f7418e9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "POST /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad/action" status: 200 len: 32 microversion: 2.1 time: 0.297820 Jun 16 16:14:34.195429 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 144/275] 10.222.0.88 () {60 vars in 1277 bytes} [Thu Jun 16 16:14:33 2022] POST /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad/action => generated 32 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 16:14:34.205148 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3c521703-fc39-4fd4-83b0-b9ad6cd14418 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:34.205795 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3c521703-fc39-4fd4-83b0-b9ad6cd14418 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:34.211971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3c521703-fc39-4fd4-83b0-b9ad6cd14418 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:34.212427 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3c521703-fc39-4fd4-83b0-b9ad6cd14418 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:34.213197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3c521703-fc39-4fd4-83b0-b9ad6cd14418 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:34.213640 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3c521703-fc39-4fd4-83b0-b9ad6cd14418 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:34.344886 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3c521703-fc39-4fd4-83b0-b9ad6cd14418 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:34.353348 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3c521703-fc39-4fd4-83b0-b9ad6cd14418 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.152078 Jun 16 16:14:34.354210 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 132/276] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:34 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:34.356625 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f5a7fb15-9fe7-45d1-8309-7140bfd41c77 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:34.357320 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f5a7fb15-9fe7-45d1-8309-7140bfd41c77 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:34.363499 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f5a7fb15-9fe7-45d1-8309-7140bfd41c77 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:34.363957 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f5a7fb15-9fe7-45d1-8309-7140bfd41c77 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:34.364724 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f5a7fb15-9fe7-45d1-8309-7140bfd41c77 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:34.365157 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f5a7fb15-9fe7-45d1-8309-7140bfd41c77 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:34.405876 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f5a7fb15-9fe7-45d1-8309-7140bfd41c77 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:34.406403 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f5a7fb15-9fe7-45d1-8309-7140bfd41c77 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:34.406919 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-f5a7fb15-9fe7-45d1-8309-7140bfd41c77 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lazy-loading 'fault' on Instance uuid 79a464c4-3b6c-48f2-b733-8970ccf82e0d {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:14:34.451620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f5a7fb15-9fe7-45d1-8309-7140bfd41c77 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:34.459534 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f5a7fb15-9fe7-45d1-8309-7140bfd41c77 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1351 microversion: 2.1 time: 0.107299 Jun 16 16:14:34.460102 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 145/277] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:34 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:35.370408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c8cf457d-a4c5-4639-8994-d9e342538c81 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:35.371019 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c8cf457d-a4c5-4639-8994-d9e342538c81 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:35.377451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c8cf457d-a4c5-4639-8994-d9e342538c81 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:35.377944 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c8cf457d-a4c5-4639-8994-d9e342538c81 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:35.378705 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c8cf457d-a4c5-4639-8994-d9e342538c81 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:35.379144 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c8cf457d-a4c5-4639-8994-d9e342538c81 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:35.476570 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-890f6a94-502c-49d2-bcda-bfb11e62f28b tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:35.477198 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-890f6a94-502c-49d2-bcda-bfb11e62f28b tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:35.484230 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-890f6a94-502c-49d2-bcda-bfb11e62f28b tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:35.484681 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-890f6a94-502c-49d2-bcda-bfb11e62f28b tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:35.485687 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-890f6a94-502c-49d2-bcda-bfb11e62f28b tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:35.486154 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-890f6a94-502c-49d2-bcda-bfb11e62f28b tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:35.517131 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c8cf457d-a4c5-4639-8994-d9e342538c81 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:35.518506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-890f6a94-502c-49d2-bcda-bfb11e62f28b tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:35.518964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-890f6a94-502c-49d2-bcda-bfb11e62f28b tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:35.519417 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-890f6a94-502c-49d2-bcda-bfb11e62f28b tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lazy-loading 'fault' on Instance uuid 79a464c4-3b6c-48f2-b733-8970ccf82e0d {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:14:35.524584 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c8cf457d-a4c5-4639-8994-d9e342538c81 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.158012 Jun 16 16:14:35.525171 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 133/278] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:35 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:35.561228 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-890f6a94-502c-49d2-bcda-bfb11e62f28b tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:35.569273 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-890f6a94-502c-49d2-bcda-bfb11e62f28b tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1351 microversion: 2.1 time: 0.096660 Jun 16 16:14:35.569858 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 146/279] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:35 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:36.542427 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0b0e1bd7-6b8b-499a-9851-c7ab1acede33 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:36.543034 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0b0e1bd7-6b8b-499a-9851-c7ab1acede33 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:36.549523 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0b0e1bd7-6b8b-499a-9851-c7ab1acede33 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:36.550009 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0b0e1bd7-6b8b-499a-9851-c7ab1acede33 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:36.550770 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0b0e1bd7-6b8b-499a-9851-c7ab1acede33 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:36.551210 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0b0e1bd7-6b8b-499a-9851-c7ab1acede33 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:36.586337 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e734cb69-0fd5-421c-8336-548067d488c2 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:36.586955 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e734cb69-0fd5-421c-8336-548067d488c2 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:36.593650 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e734cb69-0fd5-421c-8336-548067d488c2 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:36.594130 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e734cb69-0fd5-421c-8336-548067d488c2 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:36.594899 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e734cb69-0fd5-421c-8336-548067d488c2 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:36.595331 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e734cb69-0fd5-421c-8336-548067d488c2 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:36.615971 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:36.630738 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e734cb69-0fd5-421c-8336-548067d488c2 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:36.631218 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e734cb69-0fd5-421c-8336-548067d488c2 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:36.631666 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-e734cb69-0fd5-421c-8336-548067d488c2 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lazy-loading 'fault' on Instance uuid 79a464c4-3b6c-48f2-b733-8970ccf82e0d {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:14:36.688233 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e734cb69-0fd5-421c-8336-548067d488c2 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:36.697507 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e734cb69-0fd5-421c-8336-548067d488c2 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1351 microversion: 2.1 time: 0.114911 Jun 16 16:14:36.698113 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 147/280] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:36 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:36.717805 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0b0e1bd7-6b8b-499a-9851-c7ab1acede33 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:36.725764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0b0e1bd7-6b8b-499a-9851-c7ab1acede33 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.187735 Jun 16 16:14:36.726419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 134/281] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:36 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:37.714721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cc7edbdd-a82f-44b8-a19c-a3852eb8e3bb tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:37.715331 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-cc7edbdd-a82f-44b8-a19c-a3852eb8e3bb tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:37.717172 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=76 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:37.722640 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc7edbdd-a82f-44b8-a19c-a3852eb8e3bb tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:37.723097 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc7edbdd-a82f-44b8-a19c-a3852eb8e3bb tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:37.723857 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc7edbdd-a82f-44b8-a19c-a3852eb8e3bb tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:37.724292 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc7edbdd-a82f-44b8-a19c-a3852eb8e3bb tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:37.743084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d6aaa391-c3bd-4630-8201-186dbb005d2a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:37.744212 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d6aaa391-c3bd-4630-8201-186dbb005d2a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:37.750759 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d6aaa391-c3bd-4630-8201-186dbb005d2a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:37.751230 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d6aaa391-c3bd-4630-8201-186dbb005d2a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:37.752040 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d6aaa391-c3bd-4630-8201-186dbb005d2a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:37.752483 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d6aaa391-c3bd-4630-8201-186dbb005d2a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:37.755660 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc7edbdd-a82f-44b8-a19c-a3852eb8e3bb tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:37.756114 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc7edbdd-a82f-44b8-a19c-a3852eb8e3bb tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:37.756569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-cc7edbdd-a82f-44b8-a19c-a3852eb8e3bb tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lazy-loading 'fault' on Instance uuid 79a464c4-3b6c-48f2-b733-8970ccf82e0d {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:14:37.800037 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cc7edbdd-a82f-44b8-a19c-a3852eb8e3bb tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:37.809687 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cc7edbdd-a82f-44b8-a19c-a3852eb8e3bb tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1351 microversion: 2.1 time: 0.099292 Jun 16 16:14:37.810387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 148/282] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:37 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:37.895260 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d6aaa391-c3bd-4630-8201-186dbb005d2a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:37.903429 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d6aaa391-c3bd-4630-8201-186dbb005d2a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.164455 Jun 16 16:14:37.904002 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 135/283] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:37 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:38.827993 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-21a382f5-7a97-4ec1-bb15-447431337f8a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:38.828607 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-21a382f5-7a97-4ec1-bb15-447431337f8a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:38.834681 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-21a382f5-7a97-4ec1-bb15-447431337f8a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:38.835135 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-21a382f5-7a97-4ec1-bb15-447431337f8a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:38.835909 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-21a382f5-7a97-4ec1-bb15-447431337f8a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:38.836388 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-21a382f5-7a97-4ec1-bb15-447431337f8a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:38.869016 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-21a382f5-7a97-4ec1-bb15-447431337f8a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:38.869461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-21a382f5-7a97-4ec1-bb15-447431337f8a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:38.869947 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-21a382f5-7a97-4ec1-bb15-447431337f8a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lazy-loading 'fault' on Instance uuid 79a464c4-3b6c-48f2-b733-8970ccf82e0d {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:14:38.913672 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-21a382f5-7a97-4ec1-bb15-447431337f8a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:38.922542 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-78eb2cab-af2c-42dc-8859-a01d75eb7bff tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:38.923156 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-78eb2cab-af2c-42dc-8859-a01d75eb7bff tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:38.923316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-21a382f5-7a97-4ec1-bb15-447431337f8a tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1351 microversion: 2.1 time: 0.099024 Jun 16 16:14:38.923770 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 149/284] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:38 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:38.925508 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:38.933990 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-78eb2cab-af2c-42dc-8859-a01d75eb7bff tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:38.934449 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-78eb2cab-af2c-42dc-8859-a01d75eb7bff tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:38.935230 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-78eb2cab-af2c-42dc-8859-a01d75eb7bff tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:38.935662 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-78eb2cab-af2c-42dc-8859-a01d75eb7bff tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:39.070693 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-78eb2cab-af2c-42dc-8859-a01d75eb7bff tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:39.078658 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-78eb2cab-af2c-42dc-8859-a01d75eb7bff tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.161551 Jun 16 16:14:39.079228 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 136/285] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:38 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:39.941117 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4802d59f-fc1e-4682-b3c4-ff9542d38913 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:39.941739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4802d59f-fc1e-4682-b3c4-ff9542d38913 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:39.947770 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4802d59f-fc1e-4682-b3c4-ff9542d38913 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:39.948207 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4802d59f-fc1e-4682-b3c4-ff9542d38913 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:39.948952 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4802d59f-fc1e-4682-b3c4-ff9542d38913 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:39.949377 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4802d59f-fc1e-4682-b3c4-ff9542d38913 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:39.980196 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4802d59f-fc1e-4682-b3c4-ff9542d38913 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:39.980634 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4802d59f-fc1e-4682-b3c4-ff9542d38913 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:39.981069 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-4802d59f-fc1e-4682-b3c4-ff9542d38913 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lazy-loading 'fault' on Instance uuid 79a464c4-3b6c-48f2-b733-8970ccf82e0d {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:14:40.021796 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4802d59f-fc1e-4682-b3c4-ff9542d38913 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:40.030030 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4802d59f-fc1e-4682-b3c4-ff9542d38913 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1351 microversion: 2.1 time: 0.092715 Jun 16 16:14:40.030577 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 150/286] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:39 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:40.097286 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-83ae8d29-5f13-4f42-b405-a0dc1199435a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:40.097963 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-83ae8d29-5f13-4f42-b405-a0dc1199435a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:40.104702 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-83ae8d29-5f13-4f42-b405-a0dc1199435a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:40.105219 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-83ae8d29-5f13-4f42-b405-a0dc1199435a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:40.106088 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-83ae8d29-5f13-4f42-b405-a0dc1199435a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:40.106528 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-83ae8d29-5f13-4f42-b405-a0dc1199435a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:40.240558 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-83ae8d29-5f13-4f42-b405-a0dc1199435a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:40.248219 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-83ae8d29-5f13-4f42-b405-a0dc1199435a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.155005 Jun 16 16:14:40.248786 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 137/287] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:40 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:41.047155 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f3c15ed7-4316-44c5-9d64-66253eb77960 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:41.047762 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f3c15ed7-4316-44c5-9d64-66253eb77960 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:41.053838 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3c15ed7-4316-44c5-9d64-66253eb77960 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:41.054285 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3c15ed7-4316-44c5-9d64-66253eb77960 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:41.055031 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3c15ed7-4316-44c5-9d64-66253eb77960 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:41.055460 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3c15ed7-4316-44c5-9d64-66253eb77960 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:41.086293 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3c15ed7-4316-44c5-9d64-66253eb77960 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:41.086731 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3c15ed7-4316-44c5-9d64-66253eb77960 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:41.087169 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-f3c15ed7-4316-44c5-9d64-66253eb77960 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lazy-loading 'fault' on Instance uuid 79a464c4-3b6c-48f2-b733-8970ccf82e0d {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:14:41.129357 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f3c15ed7-4316-44c5-9d64-66253eb77960 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:41.139971 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f3c15ed7-4316-44c5-9d64-66253eb77960 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1351 microversion: 2.1 time: 0.096587 Jun 16 16:14:41.140754 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 151/288] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:41 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:41.264137 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cc861482-1612-4d19-8235-e2d58d02d868 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:41.264749 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-cc861482-1612-4d19-8235-e2d58d02d868 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:41.271213 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cc861482-1612-4d19-8235-e2d58d02d868 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:41.271663 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cc861482-1612-4d19-8235-e2d58d02d868 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:41.272452 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cc861482-1612-4d19-8235-e2d58d02d868 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:41.272864 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cc861482-1612-4d19-8235-e2d58d02d868 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:41.400797 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cc861482-1612-4d19-8235-e2d58d02d868 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:41.408563 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-cc861482-1612-4d19-8235-e2d58d02d868 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.148256 Jun 16 16:14:41.409121 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 138/289] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:41 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:42.156786 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1f0ae57b-ece6-4a30-a7a1-ef40506007be tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:42.157394 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1f0ae57b-ece6-4a30-a7a1-ef40506007be tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:42.164086 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1f0ae57b-ece6-4a30-a7a1-ef40506007be tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:42.164533 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1f0ae57b-ece6-4a30-a7a1-ef40506007be tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:42.165341 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1f0ae57b-ece6-4a30-a7a1-ef40506007be tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:42.167056 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1f0ae57b-ece6-4a30-a7a1-ef40506007be tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:42.197682 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1f0ae57b-ece6-4a30-a7a1-ef40506007be tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:42.198157 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1f0ae57b-ece6-4a30-a7a1-ef40506007be tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:42.198597 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-1f0ae57b-ece6-4a30-a7a1-ef40506007be tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lazy-loading 'fault' on Instance uuid 79a464c4-3b6c-48f2-b733-8970ccf82e0d {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:14:42.242223 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1f0ae57b-ece6-4a30-a7a1-ef40506007be tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2021bba1874f0fb4e6904aac576431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fb126babee4bbea59923603503a21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:42.251002 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1f0ae57b-ece6-4a30-a7a1-ef40506007be tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 200 len: 1351 microversion: 2.1 time: 0.097821 Jun 16 16:14:42.252003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 152/290] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:42 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:42.425160 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7899290d-2575-4aa2-8a76-8162eb1c0108 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:42.425795 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7899290d-2575-4aa2-8a76-8162eb1c0108 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:42.432936 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7899290d-2575-4aa2-8a76-8162eb1c0108 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:42.433436 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7899290d-2575-4aa2-8a76-8162eb1c0108 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:42.434180 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7899290d-2575-4aa2-8a76-8162eb1c0108 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:42.434617 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7899290d-2575-4aa2-8a76-8162eb1c0108 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:42.570662 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7899290d-2575-4aa2-8a76-8162eb1c0108 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:42.579764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7899290d-2575-4aa2-8a76-8162eb1c0108 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.158364 Jun 16 16:14:42.585824 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 139/291] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:42 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:43.268709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ce4d7989-2db5-4191-9398-d75374c1b0a3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:43.269086 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ce4d7989-2db5-4191-9398-d75374c1b0a3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:43.278449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ce4d7989-2db5-4191-9398-d75374c1b0a3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:43.278906 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ce4d7989-2db5-4191-9398-d75374c1b0a3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:43.279687 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ce4d7989-2db5-4191-9398-d75374c1b0a3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:43.280127 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ce4d7989-2db5-4191-9398-d75374c1b0a3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:43.295238 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-ce4d7989-2db5-4191-9398-d75374c1b0a3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] HTTP exception thrown: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ce4d7989-2db5-4191-9398-d75374c1b0a3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Request method failure captured: Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d HTTP/1.1 Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1Z3ll-N69IAHBHZQPqBF0ETuoWtxlGLJ_0lzF9SSI4Y0GZfPzHXl96DyTWvaUgzb2RwlX1HCfjJQK6g8yKH2Vm97hm35Jww5LdEFf6BTEvxDu0jV-fvkoiOLKAtNddW9Re2HGWkjiDxoQDa4eFNiKRr-K_hf9_Zl37hohdwKLNtRvs Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: 24fb126babee4bbea59923603503a21a Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-DeleteServersTestJSON-1178360874 Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:14:43.300411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:14:43.301839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/24fb126babee4bbea59923603503a21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/24fb126babee4bbea59923603503a21a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_24fb126babee4bbea59923603503a21a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/24fb126babee4bbea59923603503a21a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:14:43.301839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-DeleteServersTestJSON-1178360874 Jun 16 16:14:43.301839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 24fb126babee4bbea59923603503a21a Jun 16 16:14:43.301839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178360874 Jun 16 16:14:43.301839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-DeleteServersTestJSON-1178360874-project Jun 16 16:14:43.301839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:14:43.301839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:14:43.301839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: 5e2021bba1874f0fb4e6904aac576431 Jun 16 16:14:43.301839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-DeleteServersTestJSON-1178360874-project Jun 16 16:14:43.301839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:14:43.301839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. Jun 16 16:14:43.301839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '79a464c4-3b6c-48f2-b733-8970ccf82e0d'} Jun 16 16:14:43.302550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:14:43.302550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:14:43.302550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:14:43.302550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:14:43.302550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:14:43.302550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:14:43.302550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:14:43.302550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:14:43.302550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:14:43.302550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:14:43.302550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. Jun 16 16:14:43.302550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:14:43.302550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:14:43.302550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:14:43.302550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:14:43.302550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:14:43.302550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:14:43.302550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:14:43.302550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:14:43.302550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:14:43.303657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:14:43.303657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:14:43.303657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:14:43.303657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:14:43.303657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:14:43.303657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:14:43.303657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:14:43.303657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. Jun 16 16:14:43.303657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:14:43.303657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:14:43.303657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:14:43.303657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:14:43.303657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:14:43.303657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:14:43.303657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:14:43.303657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:14:43.303657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. Jun 16 16:14:43.303657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:14:43.304653 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ce4d7989-2db5-4191-9398-d75374c1b0a3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Returning 404 to user: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:14:43.304653 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ce4d7989-2db5-4191-9398-d75374c1b0a3 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 404 len: 111 microversion: 2.1 time: 0.037484 Jun 16 16:14:43.304653 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 153/292] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:43 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:14:43.425139 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-979dc9a3-e4fb-4b48-8ce4-acc3cf760952 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:43.426411 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-979dc9a3-e4fb-4b48-8ce4-acc3cf760952 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:43.433571 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-979dc9a3-e4fb-4b48-8ce4-acc3cf760952 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:43.434064 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-979dc9a3-e4fb-4b48-8ce4-acc3cf760952 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:43.434822 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-979dc9a3-e4fb-4b48-8ce4-acc3cf760952 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:43.435253 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-979dc9a3-e4fb-4b48-8ce4-acc3cf760952 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:43.449383 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-979dc9a3-e4fb-4b48-8ce4-acc3cf760952 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] HTTP exception thrown: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-979dc9a3-e4fb-4b48-8ce4-acc3cf760952 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Request method failure captured: Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d/os-volume_attachments HTTP/1.1 Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1Z3ll-N69IAHBHZQPqBF0ETuoWtxlGLJ_0lzF9SSI4Y0GZfPzHXl96DyTWvaUgzb2RwlX1HCfjJQK6g8yKH2Vm97hm35Jww5LdEFf6BTEvxDu0jV-fvkoiOLKAtNddW9Re2HGWkjiDxoQDa4eFNiKRr-K_hf9_Zl37hohdwKLNtRvs Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: 24fb126babee4bbea59923603503a21a Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-DeleteServersTestJSON-1178360874 Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:14:43.459192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:14:43.460612 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/24fb126babee4bbea59923603503a21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/24fb126babee4bbea59923603503a21a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_24fb126babee4bbea59923603503a21a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/24fb126babee4bbea59923603503a21a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:14:43.460612 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-DeleteServersTestJSON-1178360874 Jun 16 16:14:43.460612 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 24fb126babee4bbea59923603503a21a Jun 16 16:14:43.460612 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178360874 Jun 16 16:14:43.460612 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-DeleteServersTestJSON-1178360874-project Jun 16 16:14:43.460612 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:14:43.460612 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:14:43.460612 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: 5e2021bba1874f0fb4e6904aac576431 Jun 16 16:14:43.460612 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-DeleteServersTestJSON-1178360874-project Jun 16 16:14:43.460612 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:14:43.460612 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. Jun 16 16:14:43.460612 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'server_id': '79a464c4-3b6c-48f2-b733-8970ccf82e0d'} Jun 16 16:14:43.461551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:14:43.461551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:14:43.461551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:14:43.461551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:14:43.461551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:14:43.461551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:14:43.461551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:14:43.461551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:14:43.461551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:14:43.461551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:14:43.461551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. Jun 16 16:14:43.461551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:14:43.461551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:14:43.461551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:14:43.461551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:14:43.461551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:14:43.461551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:14:43.461551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:14:43.461551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:14:43.461551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:14:43.463435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:14:43.463435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 16:14:43.463435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:14:43.463435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 16:14:43.463435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:14:43.463435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 16:14:43.463435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 16:14:43.463435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:14:43.463435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:14:43.463435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. Jun 16 16:14:43.463435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:14:43.463435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:14:43.463435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:14:43.463435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:14:43.463435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:14:43.463435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:14:43.463435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:14:43.463435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:14:43.463435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. Jun 16 16:14:43.463435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:14:43.464712 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-979dc9a3-e4fb-4b48-8ce4-acc3cf760952 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Returning 404 to user: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:14:43.464712 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-979dc9a3-e4fb-4b48-8ce4-acc3cf760952 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033797 Jun 16 16:14:43.464712 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 140/293] 10.222.0.88 () {58 vars in 1301 bytes} [Thu Jun 16 16:14:43 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:14:43.597587 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0d837c7a-029a-4579-a6e7-73178b1ec153 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:43.598530 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0d837c7a-029a-4579-a6e7-73178b1ec153 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:43.605369 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0d837c7a-029a-4579-a6e7-73178b1ec153 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:43.607094 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0d837c7a-029a-4579-a6e7-73178b1ec153 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:43.607975 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0d837c7a-029a-4579-a6e7-73178b1ec153 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:43.608601 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0d837c7a-029a-4579-a6e7-73178b1ec153 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:43.764171 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0d837c7a-029a-4579-a6e7-73178b1ec153 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:43.772843 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0d837c7a-029a-4579-a6e7-73178b1ec153 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.180012 Jun 16 16:14:43.773539 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 154/294] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:43 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:44.715088 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4d8e7056-12a3-4871-b81e-e5991b088443 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:44.715658 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4d8e7056-12a3-4871-b81e-e5991b088443 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:44.722499 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4d8e7056-12a3-4871-b81e-e5991b088443 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:44.723151 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4d8e7056-12a3-4871-b81e-e5991b088443 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:44.723841 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4d8e7056-12a3-4871-b81e-e5991b088443 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:44.724336 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4d8e7056-12a3-4871-b81e-e5991b088443 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:44.738876 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-4d8e7056-12a3-4871-b81e-e5991b088443 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] HTTP exception thrown: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4d8e7056-12a3-4871-b81e-e5991b088443 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Request method failure captured: Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: DELETE /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d HTTP/1.1 Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1Z3ll-N69IAHBHZQPqBF0ETuoWtxlGLJ_0lzF9SSI4Y0GZfPzHXl96DyTWvaUgzb2RwlX1HCfjJQK6g8yKH2Vm97hm35Jww5LdEFf6BTEvxDu0jV-fvkoiOLKAtNddW9Re2HGWkjiDxoQDa4eFNiKRr-K_hf9_Zl37hohdwKLNtRvs Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: 24fb126babee4bbea59923603503a21a Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-DeleteServersTestJSON-1178360874 Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:14:44.741080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:14:44.742765 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/24fb126babee4bbea59923603503a21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/24fb126babee4bbea59923603503a21a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_24fb126babee4bbea59923603503a21a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/24fb126babee4bbea59923603503a21a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:14:44.742765 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-DeleteServersTestJSON-1178360874 Jun 16 16:14:44.742765 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 24fb126babee4bbea59923603503a21a Jun 16 16:14:44.742765 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178360874 Jun 16 16:14:44.742765 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-DeleteServersTestJSON-1178360874-project Jun 16 16:14:44.742765 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:14:44.742765 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:14:44.742765 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: 5e2021bba1874f0fb4e6904aac576431 Jun 16 16:14:44.742765 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-DeleteServersTestJSON-1178360874-project Jun 16 16:14:44.742765 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:14:44.742765 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. Jun 16 16:14:44.742765 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': '79a464c4-3b6c-48f2-b733-8970ccf82e0d'} Jun 16 16:14:44.743610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:14:44.743610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:14:44.743610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:14:44.743610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:14:44.743610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:14:44.743610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:14:44.743610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:14:44.743610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:14:44.743610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:14:44.743610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:14:44.743610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. Jun 16 16:14:44.743610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:14:44.743610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:14:44.743610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:14:44.743610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:14:44.743610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:14:44.743610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:14:44.743610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:14:44.743610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:14:44.743610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:14:44.744717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:14:44.744717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:14:44.744717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:14:44.744717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:14:44.744717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:14:44.744717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:14:44.744717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:14:44.744717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:14:44.744717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:14:44.744717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. Jun 16 16:14:44.744717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:14:44.744717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:14:44.744717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:14:44.744717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:14:44.744717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:14:44.744717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:14:44.744717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:14:44.744717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:14:44.744717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. Jun 16 16:14:44.744717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:14:44.745858 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4d8e7056-12a3-4871-b81e-e5991b088443 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Returning 404 to user: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:14:44.745858 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4d8e7056-12a3-4871-b81e-e5991b088443 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "DELETE /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 404 len: 111 microversion: 2.1 time: 0.031718 Jun 16 16:14:44.745858 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 141/295] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:14:44 2022] DELETE /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:14:44.751671 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ee287228-4836-4bcc-9033-0fa82e48fee6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:44.752378 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ee287228-4836-4bcc-9033-0fa82e48fee6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] [instance: 79a464c4-3b6c-48f2-b733-8970ccf82e0d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:44.759575 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ee287228-4836-4bcc-9033-0fa82e48fee6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:44.760112 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ee287228-4836-4bcc-9033-0fa82e48fee6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:44.760876 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ee287228-4836-4bcc-9033-0fa82e48fee6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:44.761402 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ee287228-4836-4bcc-9033-0fa82e48fee6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:44.776374 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-ee287228-4836-4bcc-9033-0fa82e48fee6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] HTTP exception thrown: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ee287228-4836-4bcc-9033-0fa82e48fee6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Request method failure captured: Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d HTTP/1.1 Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1Z3ll-N69IAHBHZQPqBF0ETuoWtxlGLJ_0lzF9SSI4Y0GZfPzHXl96DyTWvaUgzb2RwlX1HCfjJQK6g8yKH2Vm97hm35Jww5LdEFf6BTEvxDu0jV-fvkoiOLKAtNddW9Re2HGWkjiDxoQDa4eFNiKRr-K_hf9_Zl37hohdwKLNtRvs Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: 24fb126babee4bbea59923603503a21a Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-DeleteServersTestJSON-1178360874 Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:14:44.778079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:14:44.779610 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/24fb126babee4bbea59923603503a21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/24fb126babee4bbea59923603503a21a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_24fb126babee4bbea59923603503a21a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/24fb126babee4bbea59923603503a21a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:14:44.779610 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-DeleteServersTestJSON-1178360874 Jun 16 16:14:44.779610 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 24fb126babee4bbea59923603503a21a Jun 16 16:14:44.779610 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-DeleteServersTestJSON-1178360874 Jun 16 16:14:44.779610 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-DeleteServersTestJSON-1178360874-project Jun 16 16:14:44.779610 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:14:44.779610 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:14:44.779610 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: 5e2021bba1874f0fb4e6904aac576431 Jun 16 16:14:44.779610 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-DeleteServersTestJSON-1178360874-project Jun 16 16:14:44.779610 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:14:44.779610 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. Jun 16 16:14:44.779610 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '79a464c4-3b6c-48f2-b733-8970ccf82e0d'} Jun 16 16:14:44.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:14:44.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:14:44.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:14:44.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:14:44.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:14:44.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:14:44.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:14:44.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:14:44.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:14:44.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:14:44.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. Jun 16 16:14:44.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:14:44.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:14:44.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:14:44.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:14:44.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:14:44.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:14:44.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:14:44.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:14:44.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:14:44.784935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:14:44.784935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:14:44.784935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:14:44.784935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:14:44.784935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:14:44.784935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:14:44.784935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:14:44.784935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. Jun 16 16:14:44.784935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:14:44.784935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:14:44.784935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:14:44.784935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:14:44.784935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:14:44.784935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:14:44.784935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:14:44.784935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:14:44.784935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. Jun 16 16:14:44.784935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:14:44.786663 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ee287228-4836-4bcc-9033-0fa82e48fee6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] Returning 404 to user: Instance 79a464c4-3b6c-48f2-b733-8970ccf82e0d could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:14:44.786663 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ee287228-4836-4bcc-9033-0fa82e48fee6 tempest-DeleteServersTestJSON-1178360874 tempest-DeleteServersTestJSON-1178360874-project] 10.222.0.88 "GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d" status: 404 len: 111 microversion: 2.1 time: 0.032091 Jun 16 16:14:44.786663 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 155/296] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:44 2022] GET /compute/v2.1/servers/79a464c4-3b6c-48f2-b733-8970ccf82e0d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:14:44.792634 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-dc503ece-527a-4493-ae18-f0ca7a1734b6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:44.793417 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dc503ece-527a-4493-ae18-f0ca7a1734b6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:44.799892 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dc503ece-527a-4493-ae18-f0ca7a1734b6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:44.800596 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dc503ece-527a-4493-ae18-f0ca7a1734b6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:44.801438 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dc503ece-527a-4493-ae18-f0ca7a1734b6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:44.802063 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dc503ece-527a-4493-ae18-f0ca7a1734b6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:45.070834 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dc503ece-527a-4493-ae18-f0ca7a1734b6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:45.082275 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-dc503ece-527a-4493-ae18-f0ca7a1734b6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.294184 Jun 16 16:14:45.092303 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 142/297] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:44 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:46.100831 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e7af2732-7116-4a31-bb75-6258dee1bb0f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:46.102627 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e7af2732-7116-4a31-bb75-6258dee1bb0f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:46.110564 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e7af2732-7116-4a31-bb75-6258dee1bb0f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:46.111272 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e7af2732-7116-4a31-bb75-6258dee1bb0f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:46.112239 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e7af2732-7116-4a31-bb75-6258dee1bb0f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:46.112833 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e7af2732-7116-4a31-bb75-6258dee1bb0f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:46.384166 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e7af2732-7116-4a31-bb75-6258dee1bb0f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:46.391905 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e7af2732-7116-4a31-bb75-6258dee1bb0f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.295862 Jun 16 16:14:46.392543 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 156/298] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:46 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:47.415683 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-30062be2-bcea-4927-bb41-428e2aceab70 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:47.422507 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-30062be2-bcea-4927-bb41-428e2aceab70 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:47.443591 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-30062be2-bcea-4927-bb41-428e2aceab70 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:47.445652 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-30062be2-bcea-4927-bb41-428e2aceab70 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:47.447273 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-30062be2-bcea-4927-bb41-428e2aceab70 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:47.448798 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-30062be2-bcea-4927-bb41-428e2aceab70 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:47.752254 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-30062be2-bcea-4927-bb41-428e2aceab70 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:47.786624 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-30062be2-bcea-4927-bb41-428e2aceab70 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.380346 Jun 16 16:14:47.787266 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 143/299] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:47 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:48.804774 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-21758c49-feea-4529-84e2-c0f5a52ff73d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:48.807639 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-21758c49-feea-4529-84e2-c0f5a52ff73d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:48.814441 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-21758c49-feea-4529-84e2-c0f5a52ff73d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:48.814888 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-21758c49-feea-4529-84e2-c0f5a52ff73d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:48.815659 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-21758c49-feea-4529-84e2-c0f5a52ff73d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:48.816098 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-21758c49-feea-4529-84e2-c0f5a52ff73d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:48.973067 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-21758c49-feea-4529-84e2-c0f5a52ff73d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:48.983848 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-21758c49-feea-4529-84e2-c0f5a52ff73d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.183232 Jun 16 16:14:48.984887 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 157/300] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:48 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:49.869933 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ad3b69d3-1196-4ff0-8b99-26a6b3b0bbd8 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Action: 'create', calling method: .version_select at 0x7f6f0d1c8d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1210813001"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:50.003589 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a77c3a52-4e0f-4c26-9054-7a5f574a5264 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:50.004804 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a77c3a52-4e0f-4c26-9054-7a5f574a5264 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:50.011510 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a77c3a52-4e0f-4c26-9054-7a5f574a5264 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:50.012201 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a77c3a52-4e0f-4c26-9054-7a5f574a5264 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:50.013226 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a77c3a52-4e0f-4c26-9054-7a5f574a5264 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:50.013903 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a77c3a52-4e0f-4c26-9054-7a5f574a5264 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:50.173529 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a77c3a52-4e0f-4c26-9054-7a5f574a5264 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:50.181452 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a77c3a52-4e0f-4c26-9054-7a5f574a5264 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.182122 Jun 16 16:14:50.194615 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 158/301] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:49 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:50.204283 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ad3b69d3-1196-4ff0-8b99-26a6b3b0bbd8 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.447560 Jun 16 16:14:50.204984 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 144/302] 10.222.0.88 () {60 vars in 1154 bytes} [Thu Jun 16 16:14:49 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 449 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 16:14:50.216860 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-78eeb9ea-289d-4bc2-82b4-4a6656f335de tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2c8790>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:50.273649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-78eeb9ea-289d-4bc2-82b4-4a6656f335de tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d" status: 200 len: 345 microversion: 2.1 time: 0.060798 Jun 16 16:14:50.274871 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 159/303] 10.222.0.88 () {58 vars in 1244 bytes} [Thu Jun 16 16:14:50 2022] GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:51.202463 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f6d361dd-8c9b-4716-909b-ecbaf0658879 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:51.203072 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f6d361dd-8c9b-4716-909b-ecbaf0658879 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:51.209633 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f6d361dd-8c9b-4716-909b-ecbaf0658879 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:51.210101 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f6d361dd-8c9b-4716-909b-ecbaf0658879 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:51.210851 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f6d361dd-8c9b-4716-909b-ecbaf0658879 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:51.211284 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f6d361dd-8c9b-4716-909b-ecbaf0658879 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:51.215802 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=100 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:51.286604 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cdf78b57-130c-4e14-96a2-ffb9147b3a2d tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2c89d0>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:51.333990 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cdf78b57-130c-4e14-96a2-ffb9147b3a2d tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d" status: 200 len: 345 microversion: 2.1 time: 0.051605 Jun 16 16:14:51.339381 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 160/304] 10.222.0.88 () {58 vars in 1244 bytes} [Thu Jun 16 16:14:51 2022] GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:51.346230 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f6d361dd-8c9b-4716-909b-ecbaf0658879 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:51.354696 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f6d361dd-8c9b-4716-909b-ecbaf0658879 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.156599 Jun 16 16:14:51.355437 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 145/305] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:51 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:52.347277 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b91bc817-beac-4a76-a224-7a35487dd9b7 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2e2790>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:52.371498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d04b05c9-f367-43cc-8330-51d6421367d6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:52.372102 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d04b05c9-f367-43cc-8330-51d6421367d6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:52.379419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d04b05c9-f367-43cc-8330-51d6421367d6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:52.379884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d04b05c9-f367-43cc-8330-51d6421367d6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:52.380652 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d04b05c9-f367-43cc-8330-51d6421367d6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:52.381083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d04b05c9-f367-43cc-8330-51d6421367d6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:52.393866 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b91bc817-beac-4a76-a224-7a35487dd9b7 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d" status: 200 len: 345 microversion: 2.1 time: 0.050651 Jun 16 16:14:52.394440 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 161/306] 10.222.0.88 () {58 vars in 1244 bytes} [Thu Jun 16 16:14:52 2022] GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:52.519991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d04b05c9-f367-43cc-8330-51d6421367d6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:52.531555 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d04b05c9-f367-43cc-8330-51d6421367d6 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.163447 Jun 16 16:14:52.532968 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 146/307] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:52 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:53.410955 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-dfc8855a-eb27-45fe-a51b-614bc82547c1 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2e2550>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:53.455083 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-dfc8855a-eb27-45fe-a51b-614bc82547c1 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d" status: 200 len: 345 microversion: 2.1 time: 0.051122 Jun 16 16:14:53.455656 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 162/308] 10.222.0.88 () {58 vars in 1244 bytes} [Thu Jun 16 16:14:53 2022] GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:53.550326 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c7984b9c-7946-4186-8131-da567e2b1c72 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:53.551088 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c7984b9c-7946-4186-8131-da567e2b1c72 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:53.558298 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c7984b9c-7946-4186-8131-da567e2b1c72 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:53.558753 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c7984b9c-7946-4186-8131-da567e2b1c72 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:53.559609 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c7984b9c-7946-4186-8131-da567e2b1c72 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:53.560052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c7984b9c-7946-4186-8131-da567e2b1c72 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:53.689773 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c7984b9c-7946-4186-8131-da567e2b1c72 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:53.698221 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c7984b9c-7946-4186-8131-da567e2b1c72 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.151834 Jun 16 16:14:53.698799 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 147/309] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:53 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:54.329637 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b06a734a-8eca-4a3a-8366-b0f52c193da8 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-711547967", "imageRef": "d2716dc1-3d4d-4f62-b0af-c38986f2a3aa", "flavorRef": "452"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:54.379790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.network.neutron [None req-b06a734a-8eca-4a3a-8366-b0f52c193da8 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] validate_networks() for None {{(pid=117711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:14:54.467491 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-71dacc0f-aff4-4290-a15c-e62b11e92f43 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2c9790>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:54.514883 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-71dacc0f-aff4-4290-a15c-e62b11e92f43 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d" status: 200 len: 345 microversion: 2.1 time: 0.051160 Jun 16 16:14:54.515458 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 148/310] 10.222.0.88 () {58 vars in 1244 bytes} [Thu Jun 16 16:14:54 2022] GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:14:54.716083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8a0259d0-434b-4684-b1d7-08ba926227c4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:54.716703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8a0259d0-434b-4684-b1d7-08ba926227c4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:54.723149 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8a0259d0-434b-4684-b1d7-08ba926227c4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:54.723596 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8a0259d0-434b-4684-b1d7-08ba926227c4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:54.724366 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8a0259d0-434b-4684-b1d7-08ba926227c4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:54.724887 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8a0259d0-434b-4684-b1d7-08ba926227c4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:54.950683 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-b06a734a-8eca-4a3a-8366-b0f52c193da8 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Flavor limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:14:54.953857 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8a0259d0-434b-4684-b1d7-08ba926227c4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:54.957404 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-b06a734a-8eca-4a3a-8366-b0f52c193da8 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Image limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:14:54.958048 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-b06a734a-8eca-4a3a-8366-b0f52c193da8 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Flavor pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:14:54.958475 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-b06a734a-8eca-4a3a-8366-b0f52c193da8 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Image pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:14:54.958893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-b06a734a-8eca-4a3a-8366-b0f52c193da8 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:14:54.962576 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8a0259d0-434b-4684-b1d7-08ba926227c4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.250990 Jun 16 16:14:54.963241 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 149/311] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:54 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:54.968885 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b06a734a-8eca-4a3a-8366-b0f52c193da8 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:54.969274 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b06a734a-8eca-4a3a-8366-b0f52c193da8 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:54.970107 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b06a734a-8eca-4a3a-8366-b0f52c193da8 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:54.970542 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b06a734a-8eca-4a3a-8366-b0f52c193da8 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:54.988315 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-b06a734a-8eca-4a3a-8366-b0f52c193da8 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Getting quotas for project 999705a6bba24e4198240e1f8b08c4d9. Resources: {'ram', 'instances', 'cores'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:14:55.006746 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-b06a734a-8eca-4a3a-8366-b0f52c193da8 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Getting quotas for user 6e0dcd599835413a9271a038bec143a1 and project 999705a6bba24e4198240e1f8b08c4d9. Resources: {'ram', 'instances', 'cores'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:14:55.018905 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b06a734a-8eca-4a3a-8366-b0f52c193da8 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Going to run 1 instances... {{(pid=117711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:14:55.021253 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b06a734a-8eca-4a3a-8366-b0f52c193da8 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2716dc1-3d4d-4f62-b0af-c38986f2a3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:14:55.067102 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b06a734a-8eca-4a3a-8366-b0f52c193da8 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.741357 Jun 16 16:14:55.067742 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 163/312] 10.222.0.88 () {60 vars in 1146 bytes} [Thu Jun 16 16:14:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 16:14:55.077745 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-32523e2c-f1eb-4e7e-beea-09bef3fc60fc tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:55.078352 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-32523e2c-f1eb-4e7e-beea-09bef3fc60fc tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:55.135788 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-32523e2c-f1eb-4e7e-beea-09bef3fc60fc tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:55.142822 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-32523e2c-f1eb-4e7e-beea-09bef3fc60fc tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1214 microversion: 2.1 time: 0.068834 Jun 16 16:14:55.143395 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 150/313] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:55 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:55.518179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ce9bf775-a7fa-4ec7-8a01-9014bc0cafd5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1669566227", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-945213920", "security_groups": [{"name": "tempest-secgroup-smoke-367350092"}], "networks": [{"uuid": "96e86646-42a7-495e-a23f-a88efe673084"}], "block_device_mapping_v2": [{"uuid": "8c8e5818-45e1-403f-8ff7-35d65848d56a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:55.529242 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3614f910-dd33-4ee7-aef2-ad10570bbfdb tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2efe50>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:55.585231 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3614f910-dd33-4ee7-aef2-ad10570bbfdb tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d" status: 200 len: 346 microversion: 2.1 time: 0.061877 Jun 16 16:14:55.587394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 151/314] 10.222.0.88 () {58 vars in 1244 bytes} [Thu Jun 16 16:14:55 2022] GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:14:55.599843 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d3f9a98b-8e84-43a2-9614-d0c204ce090e tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Action: 'create', calling method: .version_select at 0x7f6f0d3055e0>, body: {"snapshot": {"volume_id": "844baaaa-eb98-4e71-8552-0da555cbdf9d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1300186865"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:14:55.714582 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.network.neutron [None req-ce9bf775-a7fa-4ec7-8a01-9014bc0cafd5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] validate_networks() for [('96e86646-42a7-495e-a23f-a88efe673084', None, None, None, None, None)] {{(pid=117711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:14:55.819548 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d3f9a98b-8e84-43a2-9614-d0c204ce090e tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.224269 Jun 16 16:14:55.820289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 152/315] 10.222.0.88 () {60 vars in 1161 bytes} [Thu Jun 16 16:14:55 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:55.830326 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e8d8170b-df0f-4897-be95-e920efb5ab5b tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d338700>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:55.867406 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e8d8170b-df0f-4897-be95-e920efb5ab5b tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 200 len: 287 microversion: 2.1 time: 0.041327 Jun 16 16:14:55.869445 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 153/316] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:14:55 2022] GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:14:55.878965 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2e1978dd-aafe-4fc5-852c-ea20f5fd949f tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2c9550>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:55.931104 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2e1978dd-aafe-4fc5-852c-ea20f5fd949f tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.056123 Jun 16 16:14:55.931976 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 154/317] 10.222.0.88 () {58 vars in 1139 bytes} [Thu Jun 16 16:14:55 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:55.942558 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-881859b6-2ad1-4c3c-85a2-2f3d33b01bb3 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2ef790>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:55.976361 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-881859b6-2ad1-4c3c-85a2-2f3d33b01bb3 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 200 len: 287 microversion: 2.1 time: 0.038093 Jun 16 16:14:55.976918 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 155/318] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:14:55 2022] GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:14:55.982567 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-07a73994-65b5-4c7f-96e1-d269d016b6ec tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:55.983173 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-07a73994-65b5-4c7f-96e1-d269d016b6ec tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:55.989228 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-07a73994-65b5-4c7f-96e1-d269d016b6ec tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:55.989681 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-07a73994-65b5-4c7f-96e1-d269d016b6ec tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:55.990536 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-07a73994-65b5-4c7f-96e1-d269d016b6ec tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:55.990954 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-07a73994-65b5-4c7f-96e1-d269d016b6ec tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:56.221169 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-07a73994-65b5-4c7f-96e1-d269d016b6ec tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:56.225486 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-ce9bf775-a7fa-4ec7-8a01-9014bc0cafd5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Flavor limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:14:56.226074 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-ce9bf775-a7fa-4ec7-8a01-9014bc0cafd5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Image limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:14:56.226667 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-ce9bf775-a7fa-4ec7-8a01-9014bc0cafd5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Flavor pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:14:56.227219 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-ce9bf775-a7fa-4ec7-8a01-9014bc0cafd5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Image pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:14:56.227834 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-ce9bf775-a7fa-4ec7-8a01-9014bc0cafd5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:14:56.229616 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-07a73994-65b5-4c7f-96e1-d269d016b6ec tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.250688 Jun 16 16:14:56.230382 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 156/319] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:55 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:56.236492 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4ec14305-ebca-40cf-be67-13c1b6411a18 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:56.236952 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ce9bf775-a7fa-4ec7-8a01-9014bc0cafd5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:56.237167 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4ec14305-ebca-40cf-be67-13c1b6411a18 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:56.237735 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ce9bf775-a7fa-4ec7-8a01-9014bc0cafd5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:56.238611 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ce9bf775-a7fa-4ec7-8a01-9014bc0cafd5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:56.239303 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ce9bf775-a7fa-4ec7-8a01-9014bc0cafd5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:56.247246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4ec14305-ebca-40cf-be67-13c1b6411a18 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:56.248088 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4ec14305-ebca-40cf-be67-13c1b6411a18 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:56.249132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4ec14305-ebca-40cf-be67-13c1b6411a18 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:56.249641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4ec14305-ebca-40cf-be67-13c1b6411a18 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:56.256754 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-ce9bf775-a7fa-4ec7-8a01-9014bc0cafd5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Getting quotas for project aed429e2356c4c7a83872d82c0540b66. Resources: {'ram', 'instances', 'cores'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:14:56.262033 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-ce9bf775-a7fa-4ec7-8a01-9014bc0cafd5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Getting quotas for user 578e9a80847d4fb18e9ea43a3ed7e8f5 and project aed429e2356c4c7a83872d82c0540b66. Resources: {'ram', 'instances', 'cores'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:14:56.318898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4ec14305-ebca-40cf-be67-13c1b6411a18 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:56.327714 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4ec14305-ebca-40cf-be67-13c1b6411a18 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1266 microversion: 2.1 time: 0.096030 Jun 16 16:14:56.328208 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 157/320] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:56 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:56.332276 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ce9bf775-a7fa-4ec7-8a01-9014bc0cafd5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Going to run 1 instances... {{(pid=117711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:14:56.334442 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ce9bf775-a7fa-4ec7-8a01-9014bc0cafd5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8c8e5818-45e1-403f-8ff7-35d65848d56a',volume_size=None,volume_type=None)] {{(pid=117711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:14:56.469240 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ce9bf775-a7fa-4ec7-8a01-9014bc0cafd5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.956262 Jun 16 16:14:56.469917 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 164/321] 10.222.0.88 () {60 vars in 1146 bytes} [Thu Jun 16 16:14:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:14:56.482014 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7ebcba13-6f53-40c8-a4be-f6f412a0eae0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:56.483715 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7ebcba13-6f53-40c8-a4be-f6f412a0eae0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:56.539913 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7ebcba13-6f53-40c8-a4be-f6f412a0eae0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:56.548058 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7ebcba13-6f53-40c8-a4be-f6f412a0eae0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1088 microversion: 2.1 time: 0.071333 Jun 16 16:14:56.549482 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 158/322] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:56 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:56.988382 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f2faaa84-2457-48b6-8187-03bdbbdac48c tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2c8d30>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:57.019940 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f2faaa84-2457-48b6-8187-03bdbbdac48c tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 200 len: 287 microversion: 2.1 time: 0.035344 Jun 16 16:14:57.020507 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 165/323] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:14:56 2022] GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:57.255433 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0e2cfbf5-5c3a-48de-ba41-aa2ba59d8b27 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:57.256034 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0e2cfbf5-5c3a-48de-ba41-aa2ba59d8b27 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:57.263972 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0e2cfbf5-5c3a-48de-ba41-aa2ba59d8b27 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:57.264414 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0e2cfbf5-5c3a-48de-ba41-aa2ba59d8b27 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:57.265169 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0e2cfbf5-5c3a-48de-ba41-aa2ba59d8b27 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:57.265598 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0e2cfbf5-5c3a-48de-ba41-aa2ba59d8b27 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:57.345736 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6182e257-7580-4c1c-896f-5ac9b4bf3781 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:57.345736 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6182e257-7580-4c1c-896f-5ac9b4bf3781 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:57.352593 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6182e257-7580-4c1c-896f-5ac9b4bf3781 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:57.353149 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6182e257-7580-4c1c-896f-5ac9b4bf3781 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:57.353957 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6182e257-7580-4c1c-896f-5ac9b4bf3781 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:57.354402 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6182e257-7580-4c1c-896f-5ac9b4bf3781 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:57.408307 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0e2cfbf5-5c3a-48de-ba41-aa2ba59d8b27 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:57.416181 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0e2cfbf5-5c3a-48de-ba41-aa2ba59d8b27 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.164653 Jun 16 16:14:57.416740 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 159/324] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:57 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:57.424976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6182e257-7580-4c1c-896f-5ac9b4bf3781 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:57.432838 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6182e257-7580-4c1c-896f-5ac9b4bf3781 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1266 microversion: 2.1 time: 0.091719 Jun 16 16:14:57.433390 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 166/325] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:57 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:57.570586 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-36dab061-a39d-463f-b7a4-81e135047c73 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:57.571256 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-36dab061-a39d-463f-b7a4-81e135047c73 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:57.578044 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-36dab061-a39d-463f-b7a4-81e135047c73 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:57.578508 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-36dab061-a39d-463f-b7a4-81e135047c73 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:57.579277 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-36dab061-a39d-463f-b7a4-81e135047c73 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:57.579718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-36dab061-a39d-463f-b7a4-81e135047c73 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:57.640188 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-36dab061-a39d-463f-b7a4-81e135047c73 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:57.648205 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-36dab061-a39d-463f-b7a4-81e135047c73 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1138 microversion: 2.1 time: 0.081512 Jun 16 16:14:57.648764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 160/326] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:57 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1138 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:58.031687 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-987e356e-aa73-4ab1-9e3d-fc21785d86f5 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2c8b80>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:58.060837 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-987e356e-aa73-4ab1-9e3d-fc21785d86f5 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 200 len: 287 microversion: 2.1 time: 0.032917 Jun 16 16:14:58.061399 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 167/327] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:14:58 2022] GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:58.434473 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-dcd8c822-5a60-49c4-a1c3-2c2d2742c833 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:58.435023 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dcd8c822-5a60-49c4-a1c3-2c2d2742c833 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:58.441398 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dcd8c822-5a60-49c4-a1c3-2c2d2742c833 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:58.441880 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dcd8c822-5a60-49c4-a1c3-2c2d2742c833 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:58.442637 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dcd8c822-5a60-49c4-a1c3-2c2d2742c833 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:58.443068 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dcd8c822-5a60-49c4-a1c3-2c2d2742c833 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:58.449042 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8dbac261-44c4-4bf3-8d63-677cc7abe121 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:58.449814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8dbac261-44c4-4bf3-8d63-677cc7abe121 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:58.456154 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8dbac261-44c4-4bf3-8d63-677cc7abe121 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:58.456635 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8dbac261-44c4-4bf3-8d63-677cc7abe121 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:58.457502 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8dbac261-44c4-4bf3-8d63-677cc7abe121 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:58.457982 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8dbac261-44c4-4bf3-8d63-677cc7abe121 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:58.543043 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8dbac261-44c4-4bf3-8d63-677cc7abe121 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:58.550977 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8dbac261-44c4-4bf3-8d63-677cc7abe121 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1266 microversion: 2.1 time: 0.105613 Jun 16 16:14:58.551583 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 168/328] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:58 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1266 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:58.604796 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dcd8c822-5a60-49c4-a1c3-2c2d2742c833 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:58.612407 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-dcd8c822-5a60-49c4-a1c3-2c2d2742c833 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.182468 Jun 16 16:14:58.612970 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 161/329] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:58 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:58.665311 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f4517e5b-9c18-43a8-bed1-e1ffb13bc2e0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:58.666025 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f4517e5b-9c18-43a8-bed1-e1ffb13bc2e0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:58.672293 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f4517e5b-9c18-43a8-bed1-e1ffb13bc2e0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:58.672735 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f4517e5b-9c18-43a8-bed1-e1ffb13bc2e0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:58.673483 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f4517e5b-9c18-43a8-bed1-e1ffb13bc2e0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:58.673955 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f4517e5b-9c18-43a8-bed1-e1ffb13bc2e0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:58.737663 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f4517e5b-9c18-43a8-bed1-e1ffb13bc2e0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:58.745434 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f4517e5b-9c18-43a8-bed1-e1ffb13bc2e0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1138 microversion: 2.1 time: 0.084838 Jun 16 16:14:58.746032 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 169/330] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:58 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:59.072489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5436aee2-363e-451f-b77d-f95135d9e12e tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2ef040>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:59.104100 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5436aee2-363e-451f-b77d-f95135d9e12e tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 200 len: 287 microversion: 2.1 time: 0.035446 Jun 16 16:14:59.104832 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 162/331] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:14:59 2022] GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:14:59.567698 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c402a452-42fd-40a0-acd7-20c3130bcb3b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:59.568298 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c402a452-42fd-40a0-acd7-20c3130bcb3b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:59.574795 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c402a452-42fd-40a0-acd7-20c3130bcb3b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:59.575232 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c402a452-42fd-40a0-acd7-20c3130bcb3b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:59.575979 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c402a452-42fd-40a0-acd7-20c3130bcb3b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:59.576407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c402a452-42fd-40a0-acd7-20c3130bcb3b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:59.629533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b8459f20-8a01-45ed-868a-a1cb15765579 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:59.630190 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b8459f20-8a01-45ed-868a-a1cb15765579 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:59.636293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b8459f20-8a01-45ed-868a-a1cb15765579 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:59.636746 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b8459f20-8a01-45ed-868a-a1cb15765579 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:59.637519 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b8459f20-8a01-45ed-868a-a1cb15765579 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:59.637996 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b8459f20-8a01-45ed-868a-a1cb15765579 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:59.638202 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c402a452-42fd-40a0-acd7-20c3130bcb3b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:59.641607 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=100 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:59.647184 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c402a452-42fd-40a0-acd7-20c3130bcb3b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1266 microversion: 2.1 time: 0.083696 Jun 16 16:14:59.648033 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 170/332] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:59 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:14:59.761617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-898deb79-5249-4364-b46f-78853adb8230 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:14:59.762272 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-898deb79-5249-4364-b46f-78853adb8230 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:14:59.768657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-898deb79-5249-4364-b46f-78853adb8230 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:59.769241 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-898deb79-5249-4364-b46f-78853adb8230 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:59.770030 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-898deb79-5249-4364-b46f-78853adb8230 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:14:59.770495 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-898deb79-5249-4364-b46f-78853adb8230 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:14:59.775492 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b8459f20-8a01-45ed-868a-a1cb15765579 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:59.783825 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b8459f20-8a01-45ed-868a-a1cb15765579 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.158763 Jun 16 16:14:59.784409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 163/333] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:59 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:14:59.834454 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-898deb79-5249-4364-b46f-78853adb8230 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:14:59.843400 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-898deb79-5249-4364-b46f-78853adb8230 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1138 microversion: 2.1 time: 0.085586 Jun 16 16:14:59.843957 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 171/334] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:14:59 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1138 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:00.116212 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7e81414e-09bb-4bca-87a8-ec09f6ff9576 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2ef5e0>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:00.147734 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7e81414e-09bb-4bca-87a8-ec09f6ff9576 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 200 len: 287 microversion: 2.1 time: 0.035717 Jun 16 16:15:00.148312 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 164/335] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:15:00 2022] GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:15:00.664343 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-04bcc78e-e410-45c4-966d-e12c091a2529 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:00.665108 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-04bcc78e-e410-45c4-966d-e12c091a2529 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:00.671553 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-04bcc78e-e410-45c4-966d-e12c091a2529 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:00.671987 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-04bcc78e-e410-45c4-966d-e12c091a2529 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:00.672728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-04bcc78e-e410-45c4-966d-e12c091a2529 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:00.673153 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-04bcc78e-e410-45c4-966d-e12c091a2529 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:00.736731 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-04bcc78e-e410-45c4-966d-e12c091a2529 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:00.744393 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-04bcc78e-e410-45c4-966d-e12c091a2529 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1266 microversion: 2.1 time: 0.083840 Jun 16 16:15:00.744959 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 172/336] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:00 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:00.801945 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-bfd1b799-9083-4ec9-a07c-19bbdf65939b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:00.802556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-bfd1b799-9083-4ec9-a07c-19bbdf65939b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:00.809477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bfd1b799-9083-4ec9-a07c-19bbdf65939b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:00.810036 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bfd1b799-9083-4ec9-a07c-19bbdf65939b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:00.810811 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bfd1b799-9083-4ec9-a07c-19bbdf65939b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:00.811243 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bfd1b799-9083-4ec9-a07c-19bbdf65939b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:00.860402 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c08e00f5-636b-4bcd-8b18-66fd3d06b6a5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:00.861115 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c08e00f5-636b-4bcd-8b18-66fd3d06b6a5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:00.867473 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c08e00f5-636b-4bcd-8b18-66fd3d06b6a5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:00.868504 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c08e00f5-636b-4bcd-8b18-66fd3d06b6a5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:00.869272 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c08e00f5-636b-4bcd-8b18-66fd3d06b6a5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:00.869778 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c08e00f5-636b-4bcd-8b18-66fd3d06b6a5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:00.936208 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c08e00f5-636b-4bcd-8b18-66fd3d06b6a5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:00.944986 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c08e00f5-636b-4bcd-8b18-66fd3d06b6a5 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1138 microversion: 2.1 time: 0.088404 Jun 16 16:15:00.945619 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 173/337] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:00 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1138 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:00.973562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-bfd1b799-9083-4ec9-a07c-19bbdf65939b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:00.981608 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-bfd1b799-9083-4ec9-a07c-19bbdf65939b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.184097 Jun 16 16:15:00.982194 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 165/338] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:00 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:01.160190 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-747486bb-145c-48a0-8790-a2a3118e7263 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d41ad30>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:01.190933 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-747486bb-145c-48a0-8790-a2a3118e7263 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 200 len: 287 microversion: 2.1 time: 0.034930 Jun 16 16:15:01.191489 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 174/339] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:15:01 2022] GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:01.761625 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-24fdcf7e-f89c-4906-a1f9-bb25cb87db10 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:01.762310 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-24fdcf7e-f89c-4906-a1f9-bb25cb87db10 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:01.768530 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-24fdcf7e-f89c-4906-a1f9-bb25cb87db10 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:01.768980 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-24fdcf7e-f89c-4906-a1f9-bb25cb87db10 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:01.769865 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-24fdcf7e-f89c-4906-a1f9-bb25cb87db10 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:01.770307 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-24fdcf7e-f89c-4906-a1f9-bb25cb87db10 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:01.835245 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-24fdcf7e-f89c-4906-a1f9-bb25cb87db10 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:01.846602 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-24fdcf7e-f89c-4906-a1f9-bb25cb87db10 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1266 microversion: 2.1 time: 0.089455 Jun 16 16:15:01.847443 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 166/340] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:01 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:01.961400 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0b1cbd9d-4167-46c4-b511-32a023448e36 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:01.962099 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0b1cbd9d-4167-46c4-b511-32a023448e36 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:01.968284 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0b1cbd9d-4167-46c4-b511-32a023448e36 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:01.968874 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0b1cbd9d-4167-46c4-b511-32a023448e36 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:01.969471 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0b1cbd9d-4167-46c4-b511-32a023448e36 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:01.969928 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0b1cbd9d-4167-46c4-b511-32a023448e36 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:02.001493 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-dd5433d0-1630-4e47-8857-632879cd8f11 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:02.002532 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dd5433d0-1630-4e47-8857-632879cd8f11 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:02.013476 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dd5433d0-1630-4e47-8857-632879cd8f11 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:02.014195 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dd5433d0-1630-4e47-8857-632879cd8f11 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:02.015175 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dd5433d0-1630-4e47-8857-632879cd8f11 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:02.015802 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dd5433d0-1630-4e47-8857-632879cd8f11 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:02.039077 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0b1cbd9d-4167-46c4-b511-32a023448e36 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:02.047571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0b1cbd9d-4167-46c4-b511-32a023448e36 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1130 microversion: 2.1 time: 0.090008 Jun 16 16:15:02.048224 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 175/341] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:01 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1130 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:02.203263 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-062e4918-63d2-4cc9-899f-ca644b91f92b tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2c8670>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:02.216046 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dd5433d0-1630-4e47-8857-632879cd8f11 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:02.226207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-dd5433d0-1630-4e47-8857-632879cd8f11 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.230621 Jun 16 16:15:02.232144 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 167/342] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:01 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:02.241160 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-062e4918-63d2-4cc9-899f-ca644b91f92b tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 200 len: 287 microversion: 2.1 time: 0.042391 Jun 16 16:15:02.241757 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 176/343] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:15:02 2022] GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:15:02.863071 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ca8c7a4b-0c98-4558-a20f-1a73c39f7714 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:02.863703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ca8c7a4b-0c98-4558-a20f-1a73c39f7714 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:02.870170 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ca8c7a4b-0c98-4558-a20f-1a73c39f7714 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:02.870633 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ca8c7a4b-0c98-4558-a20f-1a73c39f7714 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:02.871405 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ca8c7a4b-0c98-4558-a20f-1a73c39f7714 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:02.871832 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ca8c7a4b-0c98-4558-a20f-1a73c39f7714 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:02.957807 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ca8c7a4b-0c98-4558-a20f-1a73c39f7714 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:02.965323 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ca8c7a4b-0c98-4558-a20f-1a73c39f7714 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1272 microversion: 2.1 time: 0.106329 Jun 16 16:15:02.965929 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 168/344] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:02 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1272 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:03.069342 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-44ba0a6c-50f9-4a03-93da-6c78b2eb887c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:03.070786 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-44ba0a6c-50f9-4a03-93da-6c78b2eb887c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:03.077456 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-44ba0a6c-50f9-4a03-93da-6c78b2eb887c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:03.077954 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-44ba0a6c-50f9-4a03-93da-6c78b2eb887c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:03.078712 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-44ba0a6c-50f9-4a03-93da-6c78b2eb887c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:03.079142 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-44ba0a6c-50f9-4a03-93da-6c78b2eb887c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:03.151627 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-44ba0a6c-50f9-4a03-93da-6c78b2eb887c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:03.158982 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-44ba0a6c-50f9-4a03-93da-6c78b2eb887c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1186 microversion: 2.1 time: 0.094877 Jun 16 16:15:03.159560 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 177/345] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:03 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1186 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:03.244469 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d8d0843c-f9f9-4026-b6c7-35eb70078728 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:03.245099 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d8d0843c-f9f9-4026-b6c7-35eb70078728 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:03.251252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d8d0843c-f9f9-4026-b6c7-35eb70078728 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:03.251936 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d8d0843c-f9f9-4026-b6c7-35eb70078728 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:03.252885 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d8d0843c-f9f9-4026-b6c7-35eb70078728 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:03.253525 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d8d0843c-f9f9-4026-b6c7-35eb70078728 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:03.255590 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ed7bc0fa-61fa-40f0-9bcd-18bb393c7f6c tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2c88b0>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:03.303492 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ed7bc0fa-61fa-40f0-9bcd-18bb393c7f6c tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 200 len: 287 microversion: 2.1 time: 0.053420 Jun 16 16:15:03.309324 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 178/346] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:15:03 2022] GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:15:03.464290 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d8d0843c-f9f9-4026-b6c7-35eb70078728 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:03.471844 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d8d0843c-f9f9-4026-b6c7-35eb70078728 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.231842 Jun 16 16:15:03.472773 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 169/347] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:03 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:03.982643 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b6b29fbb-5094-4c01-b281-c4a323215bee tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:03.983259 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b6b29fbb-5094-4c01-b281-c4a323215bee tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:03.989216 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b6b29fbb-5094-4c01-b281-c4a323215bee tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:03.989665 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b6b29fbb-5094-4c01-b281-c4a323215bee tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:03.990461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b6b29fbb-5094-4c01-b281-c4a323215bee tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:03.990900 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b6b29fbb-5094-4c01-b281-c4a323215bee tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:04.127659 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b6b29fbb-5094-4c01-b281-c4a323215bee tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:04.136798 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b6b29fbb-5094-4c01-b281-c4a323215bee tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.157509 Jun 16 16:15:04.138280 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 179/348] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:03 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:04.176012 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-770d9a56-6645-4f3b-8ea7-adabd14a7690 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:04.176616 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-770d9a56-6645-4f3b-8ea7-adabd14a7690 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:04.183579 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-770d9a56-6645-4f3b-8ea7-adabd14a7690 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:04.184025 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-770d9a56-6645-4f3b-8ea7-adabd14a7690 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:04.184778 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-770d9a56-6645-4f3b-8ea7-adabd14a7690 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:04.185210 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-770d9a56-6645-4f3b-8ea7-adabd14a7690 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:04.246328 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-770d9a56-6645-4f3b-8ea7-adabd14a7690 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:04.253831 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-770d9a56-6645-4f3b-8ea7-adabd14a7690 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1194 microversion: 2.1 time: 0.081550 Jun 16 16:15:04.254340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 170/349] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:04 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1194 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:04.316619 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-25b37fff-476e-4dcf-a8de-aa90f2278414 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2c8af0>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:04.345345 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-25b37fff-476e-4dcf-a8de-aa90f2278414 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 200 len: 287 microversion: 2.1 time: 0.032573 Jun 16 16:15:04.345955 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 180/350] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:15:04 2022] GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:04.490284 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d5248691-d961-4379-a049-99f9b8b0f45a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:04.490900 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d5248691-d961-4379-a049-99f9b8b0f45a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:04.497534 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d5248691-d961-4379-a049-99f9b8b0f45a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:04.498025 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d5248691-d961-4379-a049-99f9b8b0f45a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:04.498796 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d5248691-d961-4379-a049-99f9b8b0f45a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:04.499237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d5248691-d961-4379-a049-99f9b8b0f45a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:04.640461 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d5248691-d961-4379-a049-99f9b8b0f45a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:04.643855 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=100 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:04.649422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d5248691-d961-4379-a049-99f9b8b0f45a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.162434 Jun 16 16:15:04.650016 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 171/351] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:04 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:05.154302 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a967aace-3537-499b-9204-e744d9e2ab4c tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:05.154911 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a967aace-3537-499b-9204-e744d9e2ab4c tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:05.160983 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a967aace-3537-499b-9204-e744d9e2ab4c tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:05.161423 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a967aace-3537-499b-9204-e744d9e2ab4c tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:05.162296 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a967aace-3537-499b-9204-e744d9e2ab4c tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:05.162794 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a967aace-3537-499b-9204-e744d9e2ab4c tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:05.271141 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a23d7b22-a193-489d-8681-e2e2536fa943 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:05.271728 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a23d7b22-a193-489d-8681-e2e2536fa943 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:05.278881 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a23d7b22-a193-489d-8681-e2e2536fa943 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:05.279325 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a23d7b22-a193-489d-8681-e2e2536fa943 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:05.280094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a23d7b22-a193-489d-8681-e2e2536fa943 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:05.280526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a23d7b22-a193-489d-8681-e2e2536fa943 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:05.291282 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a967aace-3537-499b-9204-e744d9e2ab4c tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:05.298749 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a967aace-3537-499b-9204-e744d9e2ab4c tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.148254 Jun 16 16:15:05.299321 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 181/352] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:05 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:05.340948 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a23d7b22-a193-489d-8681-e2e2536fa943 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:05.348549 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a23d7b22-a193-489d-8681-e2e2536fa943 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1194 microversion: 2.1 time: 0.081955 Jun 16 16:15:05.349111 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 172/353] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:05 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1194 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:05.357616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2540524e-025b-4d19-849c-2ee3437d9a65 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2c89d0>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:05.388086 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2540524e-025b-4d19-849c-2ee3437d9a65 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 200 len: 287 microversion: 2.1 time: 0.034161 Jun 16 16:15:05.388895 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 182/354] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:15:05 2022] GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:05.667129 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c0d326a8-df0c-4d81-972d-fb1f49317f25 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:05.667649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c0d326a8-df0c-4d81-972d-fb1f49317f25 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:05.673640 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c0d326a8-df0c-4d81-972d-fb1f49317f25 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:05.674170 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c0d326a8-df0c-4d81-972d-fb1f49317f25 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:05.674932 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c0d326a8-df0c-4d81-972d-fb1f49317f25 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:05.675382 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c0d326a8-df0c-4d81-972d-fb1f49317f25 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:05.806246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c0d326a8-df0c-4d81-972d-fb1f49317f25 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:05.813764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c0d326a8-df0c-4d81-972d-fb1f49317f25 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.150604 Jun 16 16:15:05.814331 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 173/355] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:05 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:06.312181 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=4 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:06.313055 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=12 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:06.317953 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2d2b1505-9253-49f4-9e35-3e0d95836c62 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:06.318577 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2d2b1505-9253-49f4-9e35-3e0d95836c62 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:06.326015 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2d2b1505-9253-49f4-9e35-3e0d95836c62 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:06.326466 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2d2b1505-9253-49f4-9e35-3e0d95836c62 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:06.327231 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2d2b1505-9253-49f4-9e35-3e0d95836c62 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:06.327666 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2d2b1505-9253-49f4-9e35-3e0d95836c62 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:06.365665 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-27710929-c2c4-40c7-b69f-cbdae45abb66 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:06.366238 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-27710929-c2c4-40c7-b69f-cbdae45abb66 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:06.373206 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-27710929-c2c4-40c7-b69f-cbdae45abb66 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:06.373652 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-27710929-c2c4-40c7-b69f-cbdae45abb66 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:06.374444 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-27710929-c2c4-40c7-b69f-cbdae45abb66 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:06.374873 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-27710929-c2c4-40c7-b69f-cbdae45abb66 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:06.450649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-27710929-c2c4-40c7-b69f-cbdae45abb66 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:06.458952 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-27710929-c2c4-40c7-b69f-cbdae45abb66 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1194 microversion: 2.1 time: 0.097098 Jun 16 16:15:06.459527 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 174/356] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:06 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1194 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:06.464646 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6c5bbdbe-b164-486e-891c-70d9483c6cd0 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d190a60>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:06.482173 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2d2b1505-9253-49f4-9e35-3e0d95836c62 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:06.489495 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2d2b1505-9253-49f4-9e35-3e0d95836c62 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.178095 Jun 16 16:15:06.490116 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 183/357] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:06 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:06.494909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6c5bbdbe-b164-486e-891c-70d9483c6cd0 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 200 len: 287 microversion: 2.1 time: 0.034197 Jun 16 16:15:06.495478 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 175/358] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:15:06 2022] GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:06.831433 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2e4765b8-6ad9-4cf2-9cc1-e8cdaebdfb40 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:06.832277 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2e4765b8-6ad9-4cf2-9cc1-e8cdaebdfb40 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:06.838235 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2e4765b8-6ad9-4cf2-9cc1-e8cdaebdfb40 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:06.838690 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2e4765b8-6ad9-4cf2-9cc1-e8cdaebdfb40 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:06.839456 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2e4765b8-6ad9-4cf2-9cc1-e8cdaebdfb40 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:06.839920 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2e4765b8-6ad9-4cf2-9cc1-e8cdaebdfb40 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:06.978305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2e4765b8-6ad9-4cf2-9cc1-e8cdaebdfb40 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:06.986016 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2e4765b8-6ad9-4cf2-9cc1-e8cdaebdfb40 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.158331 Jun 16 16:15:06.986590 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 184/359] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:06 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:07.473208 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=4 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:07.478578 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1240bdf3-2112-46d9-ad7a-9d695afc99d9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:07.479180 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1240bdf3-2112-46d9-ad7a-9d695afc99d9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:07.485647 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1240bdf3-2112-46d9-ad7a-9d695afc99d9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:07.486137 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1240bdf3-2112-46d9-ad7a-9d695afc99d9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:07.486909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1240bdf3-2112-46d9-ad7a-9d695afc99d9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:07.487355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1240bdf3-2112-46d9-ad7a-9d695afc99d9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:07.506512 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a038c6d8-1d8a-406a-9fc5-c131b7414781 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:07.507114 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a038c6d8-1d8a-406a-9fc5-c131b7414781 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:07.513802 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a038c6d8-1d8a-406a-9fc5-c131b7414781 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:07.514248 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a038c6d8-1d8a-406a-9fc5-c131b7414781 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:07.514998 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a038c6d8-1d8a-406a-9fc5-c131b7414781 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:07.515427 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a038c6d8-1d8a-406a-9fc5-c131b7414781 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:07.554861 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1240bdf3-2112-46d9-ad7a-9d695afc99d9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:07.562783 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1240bdf3-2112-46d9-ad7a-9d695afc99d9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1194 microversion: 2.1 time: 0.090588 Jun 16 16:15:07.563368 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 176/360] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:07 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:07.567871 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e766fd8c-74ab-4279-929c-e970a6ac18e5 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d190a60>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:07.599108 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e766fd8c-74ab-4279-929c-e970a6ac18e5 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 200 len: 287 microversion: 2.1 time: 0.034703 Jun 16 16:15:07.599680 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 177/361] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:15:07 2022] GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:07.654770 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a038c6d8-1d8a-406a-9fc5-c131b7414781 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:07.662086 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a038c6d8-1d8a-406a-9fc5-c131b7414781 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.159355 Jun 16 16:15:07.662645 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 185/362] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:07 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:08.002416 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-992d2994-6dfe-4edc-b6a3-6526f6147d14 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:08.003092 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-992d2994-6dfe-4edc-b6a3-6526f6147d14 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:08.009972 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-992d2994-6dfe-4edc-b6a3-6526f6147d14 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:08.010428 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-992d2994-6dfe-4edc-b6a3-6526f6147d14 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:08.011200 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-992d2994-6dfe-4edc-b6a3-6526f6147d14 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:08.011638 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-992d2994-6dfe-4edc-b6a3-6526f6147d14 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:08.146455 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-992d2994-6dfe-4edc-b6a3-6526f6147d14 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:08.153970 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-992d2994-6dfe-4edc-b6a3-6526f6147d14 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.155385 Jun 16 16:15:08.155085 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 178/363] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:07 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:08.580123 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6ef0eff5-afda-4bb3-a273-907174bd6049 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:08.580655 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6ef0eff5-afda-4bb3-a273-907174bd6049 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:08.582489 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:08.588158 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6ef0eff5-afda-4bb3-a273-907174bd6049 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:08.588606 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6ef0eff5-afda-4bb3-a273-907174bd6049 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:08.589366 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6ef0eff5-afda-4bb3-a273-907174bd6049 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:08.589828 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6ef0eff5-afda-4bb3-a273-907174bd6049 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:08.611197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b5628556-be1f-49d8-83dc-88fd777c9394 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d1c83a0>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:08.641663 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b5628556-be1f-49d8-83dc-88fd777c9394 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 200 len: 287 microversion: 2.1 time: 0.034629 Jun 16 16:15:08.642265 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 179/364] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:15:08 2022] GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:15:08.651919 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6ef0eff5-afda-4bb3-a273-907174bd6049 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:08.659325 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6ef0eff5-afda-4bb3-a273-907174bd6049 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1194 microversion: 2.1 time: 0.083243 Jun 16 16:15:08.659881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 186/365] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:08 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:08.678332 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9b3a31e8-7db4-4928-98cc-1e0ea7425562 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:08.678933 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9b3a31e8-7db4-4928-98cc-1e0ea7425562 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:08.685091 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9b3a31e8-7db4-4928-98cc-1e0ea7425562 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:08.685536 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9b3a31e8-7db4-4928-98cc-1e0ea7425562 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:08.686329 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9b3a31e8-7db4-4928-98cc-1e0ea7425562 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:08.686767 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9b3a31e8-7db4-4928-98cc-1e0ea7425562 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:08.814835 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9b3a31e8-7db4-4928-98cc-1e0ea7425562 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:08.822935 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9b3a31e8-7db4-4928-98cc-1e0ea7425562 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.148429 Jun 16 16:15:08.823527 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 180/366] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:08 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:09.170476 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6360910f-2945-40df-aac9-adeab941769e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:09.171087 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6360910f-2945-40df-aac9-adeab941769e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:09.176971 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6360910f-2945-40df-aac9-adeab941769e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:09.177408 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6360910f-2945-40df-aac9-adeab941769e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:09.178245 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6360910f-2945-40df-aac9-adeab941769e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:09.178603 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6360910f-2945-40df-aac9-adeab941769e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:09.311613 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6360910f-2945-40df-aac9-adeab941769e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:09.319329 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6360910f-2945-40df-aac9-adeab941769e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.152566 Jun 16 16:15:09.319886 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 187/367] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:09 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:09.652348 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ffa63d3e-873d-46f7-bc46-6ec46c16982d tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0f923820>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:09.676267 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cf091423-17f8-489c-8f54-2fb39595374a tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:09.676865 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-cf091423-17f8-489c-8f54-2fb39595374a tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:09.684008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cf091423-17f8-489c-8f54-2fb39595374a tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:09.684459 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cf091423-17f8-489c-8f54-2fb39595374a tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:09.685253 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cf091423-17f8-489c-8f54-2fb39595374a tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:09.685687 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cf091423-17f8-489c-8f54-2fb39595374a tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:09.687983 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ffa63d3e-873d-46f7-bc46-6ec46c16982d tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 200 len: 288 microversion: 2.1 time: 0.039279 Jun 16 16:15:09.688654 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 181/368] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:15:09 2022] GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 288 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:09.699612 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ef65ebbd-7856-4cc0-9b7d-0d3f88b3790a tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d190e50>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:09.748491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cf091423-17f8-489c-8f54-2fb39595374a tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:09.756468 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cf091423-17f8-489c-8f54-2fb39595374a tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1194 microversion: 2.1 time: 0.083982 Jun 16 16:15:09.757479 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 188/369] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:09 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:09.761154 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ef65ebbd-7856-4cc0-9b7d-0d3f88b3790a tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "DELETE /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 202 len: 0 microversion: 2.1 time: 0.065350 Jun 16 16:15:09.761743 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 182/370] 10.222.0.88 () {58 vars in 1253 bytes} [Thu Jun 16 16:15:09 2022] DELETE /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:15:09.769853 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-318202e8-88b2-4aad-ad21-5dbbf5287c14 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2c85e0>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:09.799333 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-318202e8-88b2-4aad-ad21-5dbbf5287c14 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 200 len: 287 microversion: 2.1 time: 0.033424 Jun 16 16:15:09.799937 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 189/371] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:15:09 2022] GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:09.839424 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b4d00935-90e4-435e-83db-dc0f12d94958 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:09.840041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b4d00935-90e4-435e-83db-dc0f12d94958 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:09.842552 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=70 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:09.848818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b4d00935-90e4-435e-83db-dc0f12d94958 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:09.849276 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b4d00935-90e4-435e-83db-dc0f12d94958 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:09.850086 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b4d00935-90e4-435e-83db-dc0f12d94958 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:09.850532 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b4d00935-90e4-435e-83db-dc0f12d94958 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:09.985947 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b4d00935-90e4-435e-83db-dc0f12d94958 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:09.993379 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b4d00935-90e4-435e-83db-dc0f12d94958 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.157870 Jun 16 16:15:09.993974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 183/372] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:09 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:10.336749 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-151c013d-c287-49c4-8519-29400f9b77b9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:10.337368 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-151c013d-c287-49c4-8519-29400f9b77b9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:10.343661 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-151c013d-c287-49c4-8519-29400f9b77b9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:10.344233 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-151c013d-c287-49c4-8519-29400f9b77b9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:10.345017 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-151c013d-c287-49c4-8519-29400f9b77b9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:10.345459 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-151c013d-c287-49c4-8519-29400f9b77b9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:10.516453 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-151c013d-c287-49c4-8519-29400f9b77b9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:10.525195 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-151c013d-c287-49c4-8519-29400f9b77b9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.192668 Jun 16 16:15:10.526158 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 190/373] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:10 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:10.774419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-bdcfabca-7f27-4ec1-93f9-672ebaf03a77 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:10.775161 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-bdcfabca-7f27-4ec1-93f9-672ebaf03a77 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:10.781685 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bdcfabca-7f27-4ec1-93f9-672ebaf03a77 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:10.782232 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bdcfabca-7f27-4ec1-93f9-672ebaf03a77 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:10.783067 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bdcfabca-7f27-4ec1-93f9-672ebaf03a77 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:10.783564 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bdcfabca-7f27-4ec1-93f9-672ebaf03a77 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:10.811639 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c08a6bd3-5f63-4109-9a33-3d2f35af8057 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2c8820>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:10.843411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c08a6bd3-5f63-4109-9a33-3d2f35af8057 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 200 len: 287 microversion: 2.1 time: 0.036140 Jun 16 16:15:10.843998 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 191/374] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:15:10 2022] GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:10.931524 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-bdcfabca-7f27-4ec1-93f9-672ebaf03a77 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:10.939213 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-bdcfabca-7f27-4ec1-93f9-672ebaf03a77 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1204 microversion: 2.1 time: 0.168670 Jun 16 16:15:10.939828 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 184/375] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:10 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1204 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:11.011671 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-162445f8-dfb9-448f-800b-38db07034728 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:11.012178 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-162445f8-dfb9-448f-800b-38db07034728 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:11.018647 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-162445f8-dfb9-448f-800b-38db07034728 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:11.019089 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-162445f8-dfb9-448f-800b-38db07034728 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:11.019910 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-162445f8-dfb9-448f-800b-38db07034728 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:11.020343 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-162445f8-dfb9-448f-800b-38db07034728 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:11.398165 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-162445f8-dfb9-448f-800b-38db07034728 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:11.406377 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-162445f8-dfb9-448f-800b-38db07034728 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.399418 Jun 16 16:15:11.406959 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 192/376] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:11 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:11.544284 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-837d38f8-02a7-4e02-90a3-bf37bff66b61 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:11.545362 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-837d38f8-02a7-4e02-90a3-bf37bff66b61 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:11.552282 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-837d38f8-02a7-4e02-90a3-bf37bff66b61 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:11.553033 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-837d38f8-02a7-4e02-90a3-bf37bff66b61 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:11.554148 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-837d38f8-02a7-4e02-90a3-bf37bff66b61 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:11.555619 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-837d38f8-02a7-4e02-90a3-bf37bff66b61 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:11.759709 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-837d38f8-02a7-4e02-90a3-bf37bff66b61 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:11.767412 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-837d38f8-02a7-4e02-90a3-bf37bff66b61 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.227615 Jun 16 16:15:11.768164 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 185/377] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:11 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:11.824499 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-cd2c0c6b-370d-4d4a-911a-a8b633a263c7 req-185a88b2-1f3b-4ab0-9007-20b12d4e33ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c", "tag": "c757db64-168f-46a4-8d08-d52739845f89"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:11.833638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-cd2c0c6b-370d-4d4a-911a-a8b633a263c7 req-185a88b2-1f3b-4ab0-9007-20b12d4e33ac service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:11.834529 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-cd2c0c6b-370d-4d4a-911a-a8b633a263c7 req-185a88b2-1f3b-4ab0-9007-20b12d4e33ac service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:11.848853 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-cd2c0c6b-370d-4d4a-911a-a8b633a263c7 req-185a88b2-1f3b-4ab0-9007-20b12d4e33ac service nova] Creating event network-changed:c757db64-168f-46a4-8d08-d52739845f89 for instance f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c on hv-cinder-83735 Jun 16 16:15:11.854642 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-cd2c0c6b-370d-4d4a-911a-a8b633a263c7 req-185a88b2-1f3b-4ab0-9007-20b12d4e33ac service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034300 Jun 16 16:15:11.855523 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fbc1efaf-fe8a-464d-9c5a-beb40637fb71 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d190430>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:11.856068 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 193/378] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:11.889284 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fbc1efaf-fe8a-464d-9c5a-beb40637fb71 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 200 len: 287 microversion: 2.1 time: 0.037656 Jun 16 16:15:11.889984 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 186/379] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:15:11 2022] GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:15:11.957456 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a6031101-4551-4060-9ffe-2074168eb7f9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:11.957903 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a6031101-4551-4060-9ffe-2074168eb7f9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:11.964270 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a6031101-4551-4060-9ffe-2074168eb7f9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:11.964724 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a6031101-4551-4060-9ffe-2074168eb7f9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:11.965499 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a6031101-4551-4060-9ffe-2074168eb7f9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:11.965965 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a6031101-4551-4060-9ffe-2074168eb7f9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:12.031954 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a6031101-4551-4060-9ffe-2074168eb7f9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:12.040101 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a6031101-4551-4060-9ffe-2074168eb7f9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1204 microversion: 2.1 time: 0.087139 Jun 16 16:15:12.040667 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 194/380] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:11 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1204 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:12.423090 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-569e501e-b6a2-42d0-83ad-32f704d4da8c tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:12.423652 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-569e501e-b6a2-42d0-83ad-32f704d4da8c tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:12.430292 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-569e501e-b6a2-42d0-83ad-32f704d4da8c tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:12.430747 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-569e501e-b6a2-42d0-83ad-32f704d4da8c tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:12.431518 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-569e501e-b6a2-42d0-83ad-32f704d4da8c tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:12.431958 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-569e501e-b6a2-42d0-83ad-32f704d4da8c tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:12.570381 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-569e501e-b6a2-42d0-83ad-32f704d4da8c tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:12.578479 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-569e501e-b6a2-42d0-83ad-32f704d4da8c tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.159325 Jun 16 16:15:12.579039 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 187/381] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:12 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:12.784297 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-00cad225-c438-42ed-8bb8-bd0c109c662a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:12.785248 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-00cad225-c438-42ed-8bb8-bd0c109c662a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:12.792070 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-00cad225-c438-42ed-8bb8-bd0c109c662a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:12.792523 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-00cad225-c438-42ed-8bb8-bd0c109c662a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:12.793293 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-00cad225-c438-42ed-8bb8-bd0c109c662a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:12.793800 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-00cad225-c438-42ed-8bb8-bd0c109c662a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:12.797969 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=100 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:12.900557 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-81ac4fd8-3415-4264-b577-bdbc5dc49632 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2ef550>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:12.921563 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-00cad225-c438-42ed-8bb8-bd0c109c662a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:12.929599 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-00cad225-c438-42ed-8bb8-bd0c109c662a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.149082 Jun 16 16:15:12.930797 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 195/382] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:12 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:12.931035 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-81ac4fd8-3415-4264-b577-bdbc5dc49632 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 200 len: 287 microversion: 2.1 time: 0.034312 Jun 16 16:15:12.931609 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 188/383] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:15:12 2022] GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:15:13.057686 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c082c8da-c63b-4ce9-b0c1-589b0a677665 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:13.058272 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c082c8da-c63b-4ce9-b0c1-589b0a677665 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:13.064357 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c082c8da-c63b-4ce9-b0c1-589b0a677665 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:13.064800 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c082c8da-c63b-4ce9-b0c1-589b0a677665 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:13.065559 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c082c8da-c63b-4ce9-b0c1-589b0a677665 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:13.066119 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c082c8da-c63b-4ce9-b0c1-589b0a677665 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:13.128474 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c082c8da-c63b-4ce9-b0c1-589b0a677665 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:13.137134 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c082c8da-c63b-4ce9-b0c1-589b0a677665 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1204 microversion: 2.1 time: 0.083812 Jun 16 16:15:13.145378 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 196/384] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:13 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1204 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:13.594912 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-367c67c6-86c3-4b2a-833b-d054d142430b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:13.595637 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-367c67c6-86c3-4b2a-833b-d054d142430b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:13.602961 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-367c67c6-86c3-4b2a-833b-d054d142430b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:13.603403 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-367c67c6-86c3-4b2a-833b-d054d142430b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:13.604163 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-367c67c6-86c3-4b2a-833b-d054d142430b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:13.604595 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-367c67c6-86c3-4b2a-833b-d054d142430b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:13.758658 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-367c67c6-86c3-4b2a-833b-d054d142430b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:13.766062 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-367c67c6-86c3-4b2a-833b-d054d142430b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.175000 Jun 16 16:15:13.766621 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 189/385] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:13 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:13.942865 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-24fccd70-7804-410c-86c7-0ff6db7c84d4 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2e2310>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:13.947180 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-95b22b98-b919-4b38-9389-f2b0f48a2dc5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:13.947820 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-95b22b98-b919-4b38-9389-f2b0f48a2dc5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:13.954554 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95b22b98-b919-4b38-9389-f2b0f48a2dc5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:13.955007 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95b22b98-b919-4b38-9389-f2b0f48a2dc5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:13.955780 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95b22b98-b919-4b38-9389-f2b0f48a2dc5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:13.956213 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95b22b98-b919-4b38-9389-f2b0f48a2dc5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:13.969533 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-24fccd70-7804-410c-86c7-0ff6db7c84d4 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] HTTP exception thrown: Snapshot 46cd1d74-9d6e-4d36-bd8b-8576925e1e9a could not be found. Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-24fccd70-7804-410c-86c7-0ff6db7c84d4 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Request method failure captured: Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a HTTP/1.1 Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1b5hGtt2IbrQtem02xvLE6O96XxyZovq2jbrQqFdp0XyTxXPsQwIWgNg6RWgqQ3M_2zNRwl5ayfzc1Y26njfVJXyaYzS5eQYJwFGKnfT7myTJWzBM9wRKgwZtNj8ncncVhG6Fc9VKAvJqAjFL7pP8Dx2JMIVfwJcSgKiuDGY0dq9DA Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: ccbee657f36d4102a56bf9e89e243e73 Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1569151080 Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:15:13.973449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:15:13.974881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ccbee657f36d4102a56bf9e89e243e73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ccbee657f36d4102a56bf9e89e243e73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ccbee657f36d4102a56bf9e89e243e73", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ccbee657f36d4102a56bf9e89e243e73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:15:13.974881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1569151080 Jun 16 16:15:13.974881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: ccbee657f36d4102a56bf9e89e243e73 Jun 16 16:15:13.974881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1569151080 Jun 16 16:15:13.974881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-VolumesSnapshotsTestJSON-1569151080-project Jun 16 16:15:13.974881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:15:13.974881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:15:13.974881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: 5c9ae15e84934f13b5543c1d6706c1bf Jun 16 16:15:13.974881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1569151080-project Jun 16 16:15:13.974881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: Jun 16 16:15:13.974881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Snapshot 46cd1d74-9d6e-4d36-bd8b-8576925e1e9a could not be found. Jun 16 16:15:13.974881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '46cd1d74-9d6e-4d36-bd8b-8576925e1e9a'} Jun 16 16:15:13.974881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:15:13.975841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:13.975841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 16:15:13.975841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 16:15:13.975841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 16:15:13.975841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 16:15:13.975841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 16:15:13.975841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 16:15:13.975841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:15:13.975841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:15:13.975841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:15:13.975841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:15:13.975841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:15:13.975841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:15:13.975841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:15:13.975841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:15:13.975841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 46cd1d74-9d6e-4d36-bd8b-8576925e1e9a could not be found. (HTTP 404) (Request-ID: req-8f28ad26-5360-4db0-b5b4-48164f4dc6b4) Jun 16 16:15:13.975841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:15:13.975841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:13.977138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:15:13.977138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:13.977138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 16:15:13.977138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 16:15:13.977138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:15:13.977138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:15:13.977138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 16:15:13.977138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 16:15:13.977138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:15:13.977138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:15:13.977138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 16:15:13.977138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 16:15:13.977138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 16:15:13.977138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 16:15:13.977138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 16:15:13.977138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 16:15:13.977138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:15:13.977138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:15:13.977138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:15:13.978734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:15:13.978734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:15:13.978734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:15:13.978734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:15:13.978734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:15:13.978734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 46cd1d74-9d6e-4d36-bd8b-8576925e1e9a could not be found. Jun 16 16:15:13.978734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:15:13.978734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:13.978734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:15:13.978734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:13.978734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:13.978734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:13.978734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:15:13.978734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:15:13.978734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:15:13.978734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:15:13.978734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:15:13.978734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:15:13.978734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 16:15:13.978734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:15:13.980085 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 46cd1d74-9d6e-4d36-bd8b-8576925e1e9a could not be found. Jun 16 16:15:13.980085 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:15:13.980085 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:13.980085 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:15:13.980085 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:13.980085 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:13.980085 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:13.980085 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:15:13.980085 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:15:13.980085 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 46cd1d74-9d6e-4d36-bd8b-8576925e1e9a could not be found. Jun 16 16:15:13.980085 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:15:13.980085 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-24fccd70-7804-410c-86c7-0ff6db7c84d4 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Returning 404 to user: Snapshot 46cd1d74-9d6e-4d36-bd8b-8576925e1e9a could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:15:13.980085 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-24fccd70-7804-410c-86c7-0ff6db7c84d4 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a" status: 404 len: 111 microversion: 2.1 time: 0.036059 Jun 16 16:15:13.981172 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 197/386] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:15:13 2022] GET /compute/v2.1/os-snapshots/46cd1d74-9d6e-4d36-bd8b-8576925e1e9a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:15:13.983074 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f3302f1a-91e3-43e0-86d0-7a26a1957479 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d41a700>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:14.049476 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f3302f1a-91e3-43e0-86d0-7a26a1957479 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d" status: 202 len: 0 microversion: 2.1 time: 0.069847 Jun 16 16:15:14.050265 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 198/387] 10.222.0.88 () {58 vars in 1247 bytes} [Thu Jun 16 16:15:13 2022] DELETE /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:15:14.058705 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f39249ca-cc0d-41e9-8f8f-657384324a0f tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d2e2d30>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:14.095939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-95b22b98-b919-4b38-9389-f2b0f48a2dc5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:14.104326 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-95b22b98-b919-4b38-9389-f2b0f48a2dc5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.161497 Jun 16 16:15:14.105036 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 190/388] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:13 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:14.108198 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f39249ca-cc0d-41e9-8f8f-657384324a0f tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d" status: 200 len: 345 microversion: 2.1 time: 0.053628 Jun 16 16:15:14.108754 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 199/389] 10.222.0.88 () {58 vars in 1244 bytes} [Thu Jun 16 16:15:14 2022] GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:14.155928 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fca12fff-82bf-4dc9-8160-414a45593b95 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:14.156528 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fca12fff-82bf-4dc9-8160-414a45593b95 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:14.162661 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fca12fff-82bf-4dc9-8160-414a45593b95 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:14.163110 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fca12fff-82bf-4dc9-8160-414a45593b95 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:14.163868 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fca12fff-82bf-4dc9-8160-414a45593b95 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:14.164317 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fca12fff-82bf-4dc9-8160-414a45593b95 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:14.224551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-fca12fff-82bf-4dc9-8160-414a45593b95 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:14.232027 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fca12fff-82bf-4dc9-8160-414a45593b95 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1204 microversion: 2.1 time: 0.080043 Jun 16 16:15:14.232585 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 191/390] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:14 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1204 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:14.782634 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-df2f5db9-f82a-42f4-b49a-7a9268097ff4 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:14.783247 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-df2f5db9-f82a-42f4-b49a-7a9268097ff4 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:14.790019 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-df2f5db9-f82a-42f4-b49a-7a9268097ff4 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:14.790466 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-df2f5db9-f82a-42f4-b49a-7a9268097ff4 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:14.791229 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-df2f5db9-f82a-42f4-b49a-7a9268097ff4 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:14.791688 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-df2f5db9-f82a-42f4-b49a-7a9268097ff4 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:14.922907 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-df2f5db9-f82a-42f4-b49a-7a9268097ff4 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:14.930883 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-df2f5db9-f82a-42f4-b49a-7a9268097ff4 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.152120 Jun 16 16:15:14.931444 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 200/391] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:14 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:15.121102 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-95280972-e0b8-4513-a198-9045abbdedee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:15.121763 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-95280972-e0b8-4513-a198-9045abbdedee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:15.124254 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6b54454e-129d-412c-a626-01e5e72d95ca tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d41a790>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:15.128406 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95280972-e0b8-4513-a198-9045abbdedee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:15.128855 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95280972-e0b8-4513-a198-9045abbdedee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:15.129624 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95280972-e0b8-4513-a198-9045abbdedee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:15.130092 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95280972-e0b8-4513-a198-9045abbdedee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:15.178494 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6b54454e-129d-412c-a626-01e5e72d95ca tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d" status: 200 len: 345 microversion: 2.1 time: 0.057972 Jun 16 16:15:15.179180 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 201/392] 10.222.0.88 () {58 vars in 1244 bytes} [Thu Jun 16 16:15:15 2022] GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:15:15.248863 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1c17cb7f-9a1f-4c85-acf5-931dc5fe7b9c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:15.249483 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1c17cb7f-9a1f-4c85-acf5-931dc5fe7b9c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:15.255885 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1c17cb7f-9a1f-4c85-acf5-931dc5fe7b9c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:15.256329 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1c17cb7f-9a1f-4c85-acf5-931dc5fe7b9c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:15.257082 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1c17cb7f-9a1f-4c85-acf5-931dc5fe7b9c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:15.257512 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1c17cb7f-9a1f-4c85-acf5-931dc5fe7b9c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:15.270382 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-95280972-e0b8-4513-a198-9045abbdedee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:15.278600 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-95280972-e0b8-4513-a198-9045abbdedee tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.162022 Jun 16 16:15:15.279786 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 192/393] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:15 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:15.327780 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1c17cb7f-9a1f-4c85-acf5-931dc5fe7b9c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:15.335252 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1c17cb7f-9a1f-4c85-acf5-931dc5fe7b9c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1204 microversion: 2.1 time: 0.090671 Jun 16 16:15:15.336325 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 202/394] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:15 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1204 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:15.947087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-409a9353-6c2e-4f8e-8b33-7f4fdff47fbe tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:15.947609 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-409a9353-6c2e-4f8e-8b33-7f4fdff47fbe tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:15.953696 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-409a9353-6c2e-4f8e-8b33-7f4fdff47fbe tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:15.954173 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-409a9353-6c2e-4f8e-8b33-7f4fdff47fbe tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:15.954928 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-409a9353-6c2e-4f8e-8b33-7f4fdff47fbe tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:15.955362 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-409a9353-6c2e-4f8e-8b33-7f4fdff47fbe tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:16.085515 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-409a9353-6c2e-4f8e-8b33-7f4fdff47fbe tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:16.093574 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-409a9353-6c2e-4f8e-8b33-7f4fdff47fbe tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.150463 Jun 16 16:15:16.094188 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 193/395] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:15 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:16.191768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2f4c4a67-a919-40cd-b556-b9df18c64bc1 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d41ab80>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:16.237946 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2f4c4a67-a919-40cd-b556-b9df18c64bc1 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d" status: 200 len: 345 microversion: 2.1 time: 0.049964 Jun 16 16:15:16.238509 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 203/396] 10.222.0.88 () {58 vars in 1244 bytes} [Thu Jun 16 16:15:16 2022] GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:16.296123 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-09310be6-a033-4048-9957-55011e7bb0c5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:16.296727 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-09310be6-a033-4048-9957-55011e7bb0c5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:16.303265 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-09310be6-a033-4048-9957-55011e7bb0c5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:16.303709 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-09310be6-a033-4048-9957-55011e7bb0c5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:16.304459 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-09310be6-a033-4048-9957-55011e7bb0c5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:16.304916 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-09310be6-a033-4048-9957-55011e7bb0c5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:16.353036 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fa9117de-ce9f-41ba-97ef-de6ecbc9b6bc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:16.353787 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fa9117de-ce9f-41ba-97ef-de6ecbc9b6bc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:16.359834 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fa9117de-ce9f-41ba-97ef-de6ecbc9b6bc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:16.360278 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fa9117de-ce9f-41ba-97ef-de6ecbc9b6bc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:16.361042 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fa9117de-ce9f-41ba-97ef-de6ecbc9b6bc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:16.361484 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fa9117de-ce9f-41ba-97ef-de6ecbc9b6bc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:16.441580 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fa9117de-ce9f-41ba-97ef-de6ecbc9b6bc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:16.449608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fa9117de-ce9f-41ba-97ef-de6ecbc9b6bc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1204 microversion: 2.1 time: 0.100878 Jun 16 16:15:16.450163 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 204/397] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:16 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1204 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:16.458859 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-09310be6-a033-4048-9957-55011e7bb0c5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:16.466971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-09310be6-a033-4048-9957-55011e7bb0c5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.174630 Jun 16 16:15:16.467535 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 194/398] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:16 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:17.111158 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e4e07536-f066-4109-9d89-df97e6879ac2 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:17.111759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e4e07536-f066-4109-9d89-df97e6879ac2 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:17.118554 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e4e07536-f066-4109-9d89-df97e6879ac2 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:17.118992 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e4e07536-f066-4109-9d89-df97e6879ac2 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:17.119736 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e4e07536-f066-4109-9d89-df97e6879ac2 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:17.120161 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e4e07536-f066-4109-9d89-df97e6879ac2 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:17.251652 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-640bc94a-8f9e-4e31-a99c-9e4924588e34 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d230a60>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:17.255390 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e4e07536-f066-4109-9d89-df97e6879ac2 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:17.267812 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e4e07536-f066-4109-9d89-df97e6879ac2 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.160235 Jun 16 16:15:17.268967 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 205/399] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:17 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:17.305745 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-640bc94a-8f9e-4e31-a99c-9e4924588e34 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d" status: 200 len: 345 microversion: 2.1 time: 0.058009 Jun 16 16:15:17.306320 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 195/400] 10.222.0.88 () {58 vars in 1244 bytes} [Thu Jun 16 16:15:17 2022] GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:17.466857 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-07b7522f-538c-4687-b9d9-0b32a3dc9412 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:17.467387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-07b7522f-538c-4687-b9d9-0b32a3dc9412 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:17.473599 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-07b7522f-538c-4687-b9d9-0b32a3dc9412 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:17.474080 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-07b7522f-538c-4687-b9d9-0b32a3dc9412 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:17.474839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-07b7522f-538c-4687-b9d9-0b32a3dc9412 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:17.475274 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-07b7522f-538c-4687-b9d9-0b32a3dc9412 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:17.484454 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-97fcb0db-9210-42d5-baf7-40ccf1400d0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:17.485136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-97fcb0db-9210-42d5-baf7-40ccf1400d0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:17.491290 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-97fcb0db-9210-42d5-baf7-40ccf1400d0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:17.491743 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-97fcb0db-9210-42d5-baf7-40ccf1400d0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:17.493006 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-97fcb0db-9210-42d5-baf7-40ccf1400d0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:17.493444 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-97fcb0db-9210-42d5-baf7-40ccf1400d0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:17.514289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=100 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:17.541483 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-07b7522f-538c-4687-b9d9-0b32a3dc9412 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:17.549757 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-07b7522f-538c-4687-b9d9-0b32a3dc9412 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1204 microversion: 2.1 time: 0.086771 Jun 16 16:15:17.550348 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 206/401] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:17 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1204 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:17.760926 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-97fcb0db-9210-42d5-baf7-40ccf1400d0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:17.772095 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-97fcb0db-9210-42d5-baf7-40ccf1400d0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.291465 Jun 16 16:15:17.773463 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 196/402] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:17 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:18.285797 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5b285eec-24d6-411d-9584-d1a80fe431aa tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:18.286555 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5b285eec-24d6-411d-9584-d1a80fe431aa tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:18.293423 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5b285eec-24d6-411d-9584-d1a80fe431aa tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:18.294621 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5b285eec-24d6-411d-9584-d1a80fe431aa tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:18.295615 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5b285eec-24d6-411d-9584-d1a80fe431aa tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:18.296244 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5b285eec-24d6-411d-9584-d1a80fe431aa tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:18.318857 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d3cd9448-f498-484f-a118-765a6dbd83a1 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d19d4c0>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:18.352867 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-d3cd9448-f498-484f-a118-765a6dbd83a1 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] HTTP exception thrown: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d3cd9448-f498-484f-a118-765a6dbd83a1 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Request method failure captured: Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d HTTP/1.1 Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1b5hGtt2IbrQtem02xvLE6O96XxyZovq2jbrQqFdp0XyTxXPsQwIWgNg6RWgqQ3M_2zNRwl5ayfzc1Y26njfVJXyaYzS5eQYJwFGKnfT7myTJWzBM9wRKgwZtNj8ncncVhG6Fc9VKAvJqAjFL7pP8Dx2JMIVfwJcSgKiuDGY0dq9DA Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: ccbee657f36d4102a56bf9e89e243e73 Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1569151080 Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:15:18.355055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:15:18.356526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ccbee657f36d4102a56bf9e89e243e73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ccbee657f36d4102a56bf9e89e243e73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ccbee657f36d4102a56bf9e89e243e73", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ccbee657f36d4102a56bf9e89e243e73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:15:18.356526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1569151080 Jun 16 16:15:18.356526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: ccbee657f36d4102a56bf9e89e243e73 Jun 16 16:15:18.356526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1569151080 Jun 16 16:15:18.356526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesSnapshotsTestJSON-1569151080-project Jun 16 16:15:18.356526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:15:18.356526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:15:18.356526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: 5c9ae15e84934f13b5543c1d6706c1bf Jun 16 16:15:18.356526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1569151080-project Jun 16 16:15:18.356526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: Jun 16 16:15:18.356526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. Jun 16 16:15:18.356526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': '844baaaa-eb98-4e71-8552-0da555cbdf9d'} Jun 16 16:15:18.356526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:15:18.357419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:18.357419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:15:18.357419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:15:18.357419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:15:18.357419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:15:18.357419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:15:18.357419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:15:18.357419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:15:18.357419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:15:18.357419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:15:18.357419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:15:18.357419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:15:18.357419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:15:18.357419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:15:18.357419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:15:18.357419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. (HTTP 404) (Request-ID: req-d29262cc-e5a7-4c47-9375-392f42cf00df) Jun 16 16:15:18.357419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.357419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:18.357419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.358719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:18.358719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 16:15:18.358719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 16:15:18.358719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:15:18.358719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:15:18.358719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:15:18.358719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:15:18.358719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:15:18.358719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:15:18.358719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:15:18.358719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:15:18.358719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:15:18.358719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:15:18.358719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:15:18.358719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:15:18.358719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:15:18.358719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:15:18.358719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:15:18.358719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:15:18.359971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:15:18.359971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:15:18.359971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:15:18.359971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:15:18.359971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. Jun 16 16:15:18.359971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.359971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:18.359971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.359971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:18.359971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:18.359971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:18.359971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:15:18.359971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:15:18.359971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:15:18.359971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:15:18.359971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:15:18.359971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:15:18.359971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 16:15:18.359971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:15:18.361541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. Jun 16 16:15:18.361541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.361541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:18.361541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.361541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:18.361541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:18.361541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:18.361541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:15:18.361541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:15:18.361541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. Jun 16 16:15:18.361541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.363253 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d3cd9448-f498-484f-a118-765a6dbd83a1 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Returning 404 to user: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:15:18.364260 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d3cd9448-f498-484f-a118-765a6dbd83a1 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d" status: 404 len: 109 microversion: 2.1 time: 0.049720 Jun 16 16:15:18.366076 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 197/403] 10.222.0.88 () {58 vars in 1244 bytes} [Thu Jun 16 16:15:18 2022] GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:15:18.376987 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-63db0be3-f7a3-4b8f-ac6d-262b449d5e96 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d1903a0>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:18.412223 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-63db0be3-f7a3-4b8f-ac6d-262b449d5e96 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] HTTP exception thrown: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-63db0be3-f7a3-4b8f-ac6d-262b449d5e96 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Request method failure captured: Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: DELETE /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d HTTP/1.1 Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1b5hGtt2IbrQtem02xvLE6O96XxyZovq2jbrQqFdp0XyTxXPsQwIWgNg6RWgqQ3M_2zNRwl5ayfzc1Y26njfVJXyaYzS5eQYJwFGKnfT7myTJWzBM9wRKgwZtNj8ncncVhG6Fc9VKAvJqAjFL7pP8Dx2JMIVfwJcSgKiuDGY0dq9DA Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: ccbee657f36d4102a56bf9e89e243e73 Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1569151080 Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:15:18.414812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:15:18.416905 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ccbee657f36d4102a56bf9e89e243e73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ccbee657f36d4102a56bf9e89e243e73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ccbee657f36d4102a56bf9e89e243e73", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ccbee657f36d4102a56bf9e89e243e73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:15:18.416905 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1569151080 Jun 16 16:15:18.416905 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: ccbee657f36d4102a56bf9e89e243e73 Jun 16 16:15:18.416905 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1569151080 Jun 16 16:15:18.416905 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesSnapshotsTestJSON-1569151080-project Jun 16 16:15:18.416905 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:15:18.416905 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:15:18.416905 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: 5c9ae15e84934f13b5543c1d6706c1bf Jun 16 16:15:18.416905 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1569151080-project Jun 16 16:15:18.416905 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: Jun 16 16:15:18.416905 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. Jun 16 16:15:18.416905 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': '844baaaa-eb98-4e71-8552-0da555cbdf9d'} Jun 16 16:15:18.416905 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:15:18.417794 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:18.417794 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:15:18.417794 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:15:18.417794 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 16:15:18.417794 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 16:15:18.417794 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 16:15:18.417794 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 16:15:18.417794 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 16:15:18.417794 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 16:15:18.417794 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 16:15:18.417794 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 16:15:18.417794 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:15:18.417794 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:15:18.417794 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:15:18.417794 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:15:18.417794 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. (HTTP 404) (Request-ID: req-07c77f27-4d49-408b-8b2f-65cd14b131ef) Jun 16 16:15:18.417794 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.417794 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:18.417794 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.420498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:18.420498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 16:15:18.420498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 16:15:18.420498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:15:18.420498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:15:18.420498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:15:18.420498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:15:18.420498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:15:18.420498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:15:18.420498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:15:18.420498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:15:18.420498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 16:15:18.420498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 16:15:18.420498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 16:15:18.420498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 16:15:18.420498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 16:15:18.420498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 16:15:18.420498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 16:15:18.420498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 16:15:18.421764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:15:18.421764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:15:18.421764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:15:18.421764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:15:18.421764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. Jun 16 16:15:18.421764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.421764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:18.421764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.421764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:18.421764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:18.421764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:18.421764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:15:18.421764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:15:18.421764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:15:18.421764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:15:18.421764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:15:18.421764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:15:18.421764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 16:15:18.421764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:15:18.423039 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. Jun 16 16:15:18.423039 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.423039 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:18.423039 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.423039 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:18.423039 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:18.423039 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:18.423039 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:15:18.423039 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:15:18.423039 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. Jun 16 16:15:18.423039 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.423039 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-63db0be3-f7a3-4b8f-ac6d-262b449d5e96 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Returning 404 to user: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:15:18.423039 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-63db0be3-f7a3-4b8f-ac6d-262b449d5e96 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d" status: 404 len: 109 microversion: 2.1 time: 0.043920 Jun 16 16:15:18.423039 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 198/404] 10.222.0.88 () {58 vars in 1247 bytes} [Thu Jun 16 16:15:18 2022] DELETE /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:15:18.428465 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8d01a1f4-c228-44f8-9971-b512518aa600 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Calling method '.version_select at 0x7f6f0d190dc0>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:18.457279 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-8d01a1f4-c228-44f8-9971-b512518aa600 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] HTTP exception thrown: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8d01a1f4-c228-44f8-9971-b512518aa600 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Request method failure captured: Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d HTTP/1.1 Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1b5hGtt2IbrQtem02xvLE6O96XxyZovq2jbrQqFdp0XyTxXPsQwIWgNg6RWgqQ3M_2zNRwl5ayfzc1Y26njfVJXyaYzS5eQYJwFGKnfT7myTJWzBM9wRKgwZtNj8ncncVhG6Fc9VKAvJqAjFL7pP8Dx2JMIVfwJcSgKiuDGY0dq9DA Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: ccbee657f36d4102a56bf9e89e243e73 Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1569151080 Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:15:18.459246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:15:18.460670 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ccbee657f36d4102a56bf9e89e243e73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ccbee657f36d4102a56bf9e89e243e73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ccbee657f36d4102a56bf9e89e243e73", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ccbee657f36d4102a56bf9e89e243e73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:15:18.460670 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1569151080 Jun 16 16:15:18.460670 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: ccbee657f36d4102a56bf9e89e243e73 Jun 16 16:15:18.460670 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1569151080 Jun 16 16:15:18.460670 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesSnapshotsTestJSON-1569151080-project Jun 16 16:15:18.460670 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:15:18.460670 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:15:18.460670 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: 5c9ae15e84934f13b5543c1d6706c1bf Jun 16 16:15:18.460670 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1569151080-project Jun 16 16:15:18.460670 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: Jun 16 16:15:18.460670 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. Jun 16 16:15:18.460670 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': '844baaaa-eb98-4e71-8552-0da555cbdf9d'} Jun 16 16:15:18.460670 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:15:18.462477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:18.462477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:15:18.462477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:15:18.462477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:15:18.462477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:15:18.462477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:15:18.462477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:15:18.462477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:15:18.462477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:15:18.462477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:15:18.462477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:15:18.462477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:15:18.462477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:15:18.462477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:15:18.462477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:15:18.462477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. (HTTP 404) (Request-ID: req-fc83de41-8064-41f6-b501-d3c602fc4eab) Jun 16 16:15:18.462477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.462477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:18.462477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.463505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:18.463505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 16:15:18.463505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 16:15:18.463505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:15:18.463505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:15:18.463505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:15:18.463505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:15:18.463505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:15:18.463505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:15:18.463505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:15:18.463505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:15:18.463505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:15:18.463505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:15:18.463505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:15:18.463505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:15:18.463505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:15:18.463505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:15:18.463505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:15:18.463505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:15:18.465394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:15:18.465394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:15:18.465394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:15:18.465394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:15:18.465394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. Jun 16 16:15:18.465394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.465394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:18.465394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.465394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:18.465394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:18.465394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:18.465394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:15:18.465394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:15:18.465394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:15:18.465394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:15:18.465394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:15:18.465394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:15:18.465394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 16:15:18.465394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:15:18.467322 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. Jun 16 16:15:18.467322 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.467322 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:18.467322 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.467322 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:18.467322 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:18.467322 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:18.467322 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:15:18.467322 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:15:18.467322 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. Jun 16 16:15:18.467322 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:18.467322 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8d01a1f4-c228-44f8-9971-b512518aa600 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] Returning 404 to user: Volume 844baaaa-eb98-4e71-8552-0da555cbdf9d could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:15:18.467322 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8d01a1f4-c228-44f8-9971-b512518aa600 tempest-VolumesSnapshotsTestJSON-1569151080 tempest-VolumesSnapshotsTestJSON-1569151080-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d" status: 404 len: 109 microversion: 2.1 time: 0.035974 Jun 16 16:15:18.467322 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 199/405] 10.222.0.88 () {58 vars in 1244 bytes} [Thu Jun 16 16:15:18 2022] GET /compute/v2.1/os-volumes/844baaaa-eb98-4e71-8552-0da555cbdf9d => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:15:18.569369 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4398cf3b-ad62-4589-a8be-af8101f7c0e8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:18.569847 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4398cf3b-ad62-4589-a8be-af8101f7c0e8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:18.576778 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4398cf3b-ad62-4589-a8be-af8101f7c0e8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:18.577422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4398cf3b-ad62-4589-a8be-af8101f7c0e8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:18.578257 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4398cf3b-ad62-4589-a8be-af8101f7c0e8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:18.578701 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4398cf3b-ad62-4589-a8be-af8101f7c0e8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:18.651464 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5b285eec-24d6-411d-9584-d1a80fe431aa tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:18.659202 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5b285eec-24d6-411d-9584-d1a80fe431aa tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.377334 Jun 16 16:15:18.660397 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 207/406] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:18 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:18.790470 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-89c1c0f7-18b1-446c-a67b-90b5d66133f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:18.791630 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-89c1c0f7-18b1-446c-a67b-90b5d66133f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:18.800319 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-89c1c0f7-18b1-446c-a67b-90b5d66133f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:18.801159 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-89c1c0f7-18b1-446c-a67b-90b5d66133f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:18.803680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-89c1c0f7-18b1-446c-a67b-90b5d66133f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:18.804819 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-89c1c0f7-18b1-446c-a67b-90b5d66133f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:18.868500 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4398cf3b-ad62-4589-a8be-af8101f7c0e8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:18.877188 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4398cf3b-ad62-4589-a8be-af8101f7c0e8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.313489 Jun 16 16:15:18.877905 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 200/407] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:18 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:19.036779 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-89c1c0f7-18b1-446c-a67b-90b5d66133f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:19.053830 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-89c1c0f7-18b1-446c-a67b-90b5d66133f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.267817 Jun 16 16:15:19.071219 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 208/408] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:18 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:19.403242 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-d8cd9bf5-40b8-4078-9fc3-a23c5db29e8a req-7909e15c-35eb-4c89-88a8-f81d92fba627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c92e5c48-0ac8-4a24-9e6b-019b7825b0b4", "tag": "fd0e55d6-c023-4540-8b9f-28e600c52b4f"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:19.434105 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-d8cd9bf5-40b8-4078-9fc3-a23c5db29e8a req-7909e15c-35eb-4c89-88a8-f81d92fba627 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:19.434773 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-d8cd9bf5-40b8-4078-9fc3-a23c5db29e8a req-7909e15c-35eb-4c89-88a8-f81d92fba627 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:19.455285 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-d8cd9bf5-40b8-4078-9fc3-a23c5db29e8a req-7909e15c-35eb-4c89-88a8-f81d92fba627 service nova] Creating event network-changed:fd0e55d6-c023-4540-8b9f-28e600c52b4f for instance c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 on hv-cinder-83735 Jun 16 16:15:19.461238 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-d8cd9bf5-40b8-4078-9fc3-a23c5db29e8a req-7909e15c-35eb-4c89-88a8-f81d92fba627 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062712 Jun 16 16:15:19.462428 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 201/409] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:15:19.676123 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5a6550db-5663-4bc6-92db-bde6bd0617d0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:19.676767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5a6550db-5663-4bc6-92db-bde6bd0617d0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:19.689430 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5a6550db-5663-4bc6-92db-bde6bd0617d0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:19.690697 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5a6550db-5663-4bc6-92db-bde6bd0617d0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:19.691982 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5a6550db-5663-4bc6-92db-bde6bd0617d0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:19.692730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5a6550db-5663-4bc6-92db-bde6bd0617d0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:19.898743 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-058ecf1c-ec2b-4c01-854a-45a00828dec6 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:19.901037 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-058ecf1c-ec2b-4c01-854a-45a00828dec6 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:19.907949 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-058ecf1c-ec2b-4c01-854a-45a00828dec6 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:19.908590 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-058ecf1c-ec2b-4c01-854a-45a00828dec6 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:19.909379 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-058ecf1c-ec2b-4c01-854a-45a00828dec6 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:19.910125 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-058ecf1c-ec2b-4c01-854a-45a00828dec6 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:20.106406 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5a6550db-5663-4bc6-92db-bde6bd0617d0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:20.114941 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5a6550db-5663-4bc6-92db-bde6bd0617d0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.442282 Jun 16 16:15:20.115870 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 209/410] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:19 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:20.122157 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-77de1623-2eac-4b56-ad34-b01c39695e0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:20.123045 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-77de1623-2eac-4b56-ad34-b01c39695e0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:20.129527 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-77de1623-2eac-4b56-ad34-b01c39695e0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:20.130669 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-77de1623-2eac-4b56-ad34-b01c39695e0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:20.131763 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-77de1623-2eac-4b56-ad34-b01c39695e0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:20.132206 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-77de1623-2eac-4b56-ad34-b01c39695e0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:20.514915 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-058ecf1c-ec2b-4c01-854a-45a00828dec6 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:20.523345 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-058ecf1c-ec2b-4c01-854a-45a00828dec6 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.631952 Jun 16 16:15:20.523922 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 202/411] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:19 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:20.591244 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-77de1623-2eac-4b56-ad34-b01c39695e0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:20.599364 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-77de1623-2eac-4b56-ad34-b01c39695e0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1503 microversion: 2.1 time: 0.482082 Jun 16 16:15:20.599949 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 210/412] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:20 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1503 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:20.615450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-907bbf84-022a-4eab-99fc-def186dc3b3a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0c3a25c-500d-472f-bb62-d22613fbe973"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:20.616587 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-907bbf84-022a-4eab-99fc-def186dc3b3a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:20.623064 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-907bbf84-022a-4eab-99fc-def186dc3b3a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:20.623509 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-907bbf84-022a-4eab-99fc-def186dc3b3a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:20.624271 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-907bbf84-022a-4eab-99fc-def186dc3b3a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:20.624703 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-907bbf84-022a-4eab-99fc-def186dc3b3a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:20.648854 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-907bbf84-022a-4eab-99fc-def186dc3b3a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] HTTP exception thrown: Cannot 'attach_volume' instance 7c1389bc-ae98-44d1-943a-669b44dde9ad while it is in vm_state rescued Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-907bbf84-022a-4eab-99fc-def186dc3b3a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Request method failure captured: Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: POST /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad/os-volume_attachments HTTP/1.1 Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 74 Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1Z54hJE2l_KKrM9e-Q92EFzRQefo-JKdfbLMPwz8oT-C787IrLRWMX8P4Lf_5ySi9IC_PuB8AW1WtFXSETwf3dcsXRZWC9FFHHN_a0Os7DqGZog0zeiyFPM_4eOL5z3sIiGBxl1xGfVrAMC6ZsPAzRZXMxNahInJw9LdOx_iPcmPBQ Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: c3592ee016d1486db983b4ff2aab5ca3 Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1916877350 Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:15:20.650701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:15:20.651941 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c3592ee016d1486db983b4ff2aab5ca3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c3592ee016d1486db983b4ff2aab5ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c3592ee016d1486db983b4ff2aab5ca3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c3592ee016d1486db983b4ff2aab5ca3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:15:20.651941 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1916877350 Jun 16 16:15:20.651941 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: c3592ee016d1486db983b4ff2aab5ca3 Jun 16 16:15:20.651941 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1916877350 Jun 16 16:15:20.651941 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-ServerRescueNegativeTestJSON-1916877350-project Jun 16 16:15:20.651941 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:15:20.651941 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:15:20.651941 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: 16b8389777744e6581ad14be85731f4a Jun 16 16:15:20.651941 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1916877350-project Jun 16 16:15:20.651941 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Jun 16 16:15:20.651941 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {"volumeAttachment": {"volumeId": "c0c3a25c-500d-472f-bb62-d22613fbe973"}} Jun 16 16:15:20.651941 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:15:20.652709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Cannot 'attach_volume' instance 7c1389bc-ae98-44d1-943a-669b44dde9ad while it is in vm_state rescued Jun 16 16:15:20.652709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'server_id': '7c1389bc-ae98-44d1-943a-669b44dde9ad', 'body': {'volumeAttachment': {'volumeId': 'c0c3a25c-500d-472f-bb62-d22613fbe973'}}} Jun 16 16:15:20.652709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:15:20.652709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.652709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 16:15:20.652709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 16:15:20.652709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 16:15:20.652709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 16:15:20.652709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 16:15:20.652709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 16:15:20.652709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7c1389bc-ae98-44d1-943a-669b44dde9ad in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 16:15:20.652709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.652709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:20.652709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.652709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.652709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:20.652709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:20.652709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:15:20.652709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:15:20.654327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:15:20.654327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:15:20.654327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:15:20.654327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:15:20.654327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:15:20.654327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:15:20.654327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:15:20.654327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:15:20.654327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 16:15:20.654327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 16:15:20.654327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 16:15:20.654327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 16:15:20.654327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7c1389bc-ae98-44d1-943a-669b44dde9ad while it is in vm_state rescued Jun 16 16:15:20.654327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.654327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:20.654327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.654327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.654327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:20.654327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:20.655400 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:15:20.655400 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:15:20.655400 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7c1389bc-ae98-44d1-943a-669b44dde9ad while it is in vm_state rescued Jun 16 16:15:20.655400 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.655400 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-907bbf84-022a-4eab-99fc-def186dc3b3a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Returning 409 to user: Cannot 'attach_volume' instance 7c1389bc-ae98-44d1-943a-669b44dde9ad while it is in vm_state rescued {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:15:20.655400 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-907bbf84-022a-4eab-99fc-def186dc3b3a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "POST /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040580 Jun 16 16:15:20.655400 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 211/413] 10.222.0.88 () {60 vars in 1322 bytes} [Thu Jun 16 16:15:20 2022] POST /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 16 16:15:20.660975 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-25d455fb-ec13-46e5-af8e-165a6e383ec1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:20.661497 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-25d455fb-ec13-46e5-af8e-165a6e383ec1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:20.667496 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-25d455fb-ec13-46e5-af8e-165a6e383ec1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:20.667947 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-25d455fb-ec13-46e5-af8e-165a6e383ec1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:20.668734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-25d455fb-ec13-46e5-af8e-165a6e383ec1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:20.669165 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-25d455fb-ec13-46e5-af8e-165a6e383ec1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:20.691837 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c1d111e7-0713-4c47-9301-5cd6c62a796b tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] Action: 'create', calling method: .version_select at 0x7f6f0d1d1dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1442880837", "metadata": {"Type": "work"}}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c1d111e7-0713-4c47-9301-5cd6c62a796b tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] Request method failure captured: Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 122 Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1cYpsv7sxQso4qppDdlbaVcntQmTz7wivE_R4-1rBdgvKyBN1j0BqDAm5bixYDwIC_a8R8MmeyDj_mY5ftzpYQDBue83vBMfVb7DpI3KEhMjVkNKMKvxh91o5rlgdwJHsJ4qazq_g4d_oL7e_2xpIK9TeATJWR4CgXKq6LxDWnGfXQ Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: d9e4d20155164b3d9cbe4f0a893e18c7 Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesNegativeTest-1970665341 Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:15:20.712884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:15:20.714474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d9e4d20155164b3d9cbe4f0a893e18c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d9e4d20155164b3d9cbe4f0a893e18c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d9e4d20155164b3d9cbe4f0a893e18c7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d9e4d20155164b3d9cbe4f0a893e18c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:15:20.714474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesNegativeTest-1970665341 Jun 16 16:15:20.714474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: d9e4d20155164b3d9cbe4f0a893e18c7 Jun 16 16:15:20.714474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesNegativeTest-1970665341 Jun 16 16:15:20.714474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesNegativeTest-1970665341-project Jun 16 16:15:20.714474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:15:20.714474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:15:20.714474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: ede7cbb4890e486c8c28a0cb327db115 Jun 16 16:15:20.714474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesNegativeTest-1970665341-project Jun 16 16:15:20.714474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Jun 16 16:15:20.714474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1442880837", "metadata": {"Type": "work"}}} Jun 16 16:15:20.714474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: Jun 16 16:15:20.714474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1442880837', 'metadata': {'Type': 'work'}}}} Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise error Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:15:20.715401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:15:20.716898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:15:20.716898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:15:20.716898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:15:20.716898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:15:20.716898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 16:15:20.716898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 16:15:20.716898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 16:15:20.716898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 16:15:20.716898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 16:15:20.716898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 16:15:20.716898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 16:15:20.716898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.716898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:20.716898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.716898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.716898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:20.716898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:20.716898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 16:15:20.716898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 16:15:20.718111 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 16:15:20.718111 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.718111 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c1d111e7-0713-4c47-9301-5cd6c62a796b tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:15:20.718111 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c1d111e7-0713-4c47-9301-5cd6c62a796b tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.191299 Jun 16 16:15:20.718111 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 203/414] 10.222.0.88 () {60 vars in 1155 bytes} [Thu Jun 16 16:15:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:15:20.727571 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cb679b95-116a-4043-9d82-81f843b49de4 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] Action: 'create', calling method: .version_select at 0x7f6f0d1c8160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1868691293", "metadata": {"Type": "work"}}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cb679b95-116a-4043-9d82-81f843b49de4 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] Request method failure captured: Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 120 Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1cYpsv7sxQso4qppDdlbaVcntQmTz7wivE_R4-1rBdgvKyBN1j0BqDAm5bixYDwIC_a8R8MmeyDj_mY5ftzpYQDBue83vBMfVb7DpI3KEhMjVkNKMKvxh91o5rlgdwJHsJ4qazq_g4d_oL7e_2xpIK9TeATJWR4CgXKq6LxDWnGfXQ Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: d9e4d20155164b3d9cbe4f0a893e18c7 Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesNegativeTest-1970665341 Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:15:20.731308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:15:20.732570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d9e4d20155164b3d9cbe4f0a893e18c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d9e4d20155164b3d9cbe4f0a893e18c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d9e4d20155164b3d9cbe4f0a893e18c7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d9e4d20155164b3d9cbe4f0a893e18c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:15:20.732570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesNegativeTest-1970665341 Jun 16 16:15:20.732570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: d9e4d20155164b3d9cbe4f0a893e18c7 Jun 16 16:15:20.732570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesNegativeTest-1970665341 Jun 16 16:15:20.732570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesNegativeTest-1970665341-project Jun 16 16:15:20.732570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:15:20.732570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:15:20.732570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: ede7cbb4890e486c8c28a0cb327db115 Jun 16 16:15:20.732570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesNegativeTest-1970665341-project Jun 16 16:15:20.732570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Jun 16 16:15:20.732570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1868691293", "metadata": {"Type": "work"}}} Jun 16 16:15:20.732570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: Jun 16 16:15:20.732570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1868691293', 'metadata': {'Type': 'work'}}}} Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise error Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi '0' Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:15:20.733409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:15:20.734866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:15:20.734866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:15:20.734866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:15:20.734866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:15:20.734866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 16:15:20.734866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 16:15:20.734866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 16:15:20.734866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 16:15:20.734866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 16:15:20.734866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 16:15:20.734866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 16:15:20.734866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.734866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:20.734866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.734866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.734866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:20.734866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:20.734866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 16:15:20.734866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 16:15:20.736056 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 16:15:20.736056 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.736056 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cb679b95-116a-4043-9d82-81f843b49de4 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:15:20.736056 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-cb679b95-116a-4043-9d82-81f843b49de4 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010278 Jun 16 16:15:20.736056 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 204/415] 10.222.0.88 () {60 vars in 1155 bytes} [Thu Jun 16 16:15:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:15:20.746244 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-64528ae8-17f7-429b-b7c6-8fde36de1357 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] Action: 'create', calling method: .version_select at 0x7f6f0d1c80d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1257113805", "metadata": {"Type": "work"}}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:20.746724 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-25d455fb-ec13-46e5-af8e-165a6e383ec1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "POST /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad/action" status: 202 len: 0 microversion: 2.1 time: 0.088770 Jun 16 16:15:20.747916 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 212/416] 10.222.0.88 () {60 vars in 1277 bytes} [Thu Jun 16 16:15:20 2022] POST /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-64528ae8-17f7-429b-b7c6-8fde36de1357 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] Request method failure captured: Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 119 Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1cYpsv7sxQso4qppDdlbaVcntQmTz7wivE_R4-1rBdgvKyBN1j0BqDAm5bixYDwIC_a8R8MmeyDj_mY5ftzpYQDBue83vBMfVb7DpI3KEhMjVkNKMKvxh91o5rlgdwJHsJ4qazq_g4d_oL7e_2xpIK9TeATJWR4CgXKq6LxDWnGfXQ Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: d9e4d20155164b3d9cbe4f0a893e18c7 Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesNegativeTest-1970665341 Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:15:20.748293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:15:20.750641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d9e4d20155164b3d9cbe4f0a893e18c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d9e4d20155164b3d9cbe4f0a893e18c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d9e4d20155164b3d9cbe4f0a893e18c7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d9e4d20155164b3d9cbe4f0a893e18c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:15:20.750641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesNegativeTest-1970665341 Jun 16 16:15:20.750641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: d9e4d20155164b3d9cbe4f0a893e18c7 Jun 16 16:15:20.750641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesNegativeTest-1970665341 Jun 16 16:15:20.750641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesNegativeTest-1970665341-project Jun 16 16:15:20.750641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:15:20.750641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:15:20.750641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: ede7cbb4890e486c8c28a0cb327db115 Jun 16 16:15:20.750641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesNegativeTest-1970665341-project Jun 16 16:15:20.750641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Jun 16 16:15:20.750641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1257113805", "metadata": {"Type": "work"}}} Jun 16 16:15:20.750641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: Jun 16 16:15:20.750641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1257113805', 'metadata': {'Type': 'work'}}}} Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise error Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi '' Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:15:20.752155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:15:20.754356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:15:20.754356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:15:20.754356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:15:20.754356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:15:20.754356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 16:15:20.754356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 16:15:20.754356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 16:15:20.754356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 16:15:20.754356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 16:15:20.754356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 16:15:20.754356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 16:15:20.754356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.754356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:20.754356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.754356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.754356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:20.754356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:20.754356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 16:15:20.754356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 16:15:20.756771 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 16:15:20.756771 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.756771 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-64528ae8-17f7-429b-b7c6-8fde36de1357 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:15:20.756771 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-64528ae8-17f7-429b-b7c6-8fde36de1357 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007846 Jun 16 16:15:20.756771 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 205/417] 10.222.0.88 () {60 vars in 1155 bytes} [Thu Jun 16 16:15:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 16:15:20.759804 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-46d6886e-e76b-46b4-9383-bf7e4c246195 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:20.760612 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-46d6886e-e76b-46b4-9383-bf7e4c246195 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:20.761674 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-aac4e71b-df7e-4913-be10-6d16ed084c98 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] Calling method '.version_select at 0x7f6f0d1d1040>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:20.767217 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-46d6886e-e76b-46b4-9383-bf7e4c246195 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:20.767665 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-46d6886e-e76b-46b4-9383-bf7e4c246195 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:20.768924 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-46d6886e-e76b-46b4-9383-bf7e4c246195 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:20.769195 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-46d6886e-e76b-46b4-9383-bf7e4c246195 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:20.795671 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-aac4e71b-df7e-4913-be10-6d16ed084c98 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] HTTP exception thrown: Volume tempest-invalid-1310864853 could not be found. Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-aac4e71b-df7e-4913-be10-6d16ed084c98 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] Request method failure captured: Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1310864853 HTTP/1.1 Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1cYpsv7sxQso4qppDdlbaVcntQmTz7wivE_R4-1rBdgvKyBN1j0BqDAm5bixYDwIC_a8R8MmeyDj_mY5ftzpYQDBue83vBMfVb7DpI3KEhMjVkNKMKvxh91o5rlgdwJHsJ4qazq_g4d_oL7e_2xpIK9TeATJWR4CgXKq6LxDWnGfXQ Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: d9e4d20155164b3d9cbe4f0a893e18c7 Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesNegativeTest-1970665341 Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:15:20.797618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:15:20.799185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d9e4d20155164b3d9cbe4f0a893e18c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d9e4d20155164b3d9cbe4f0a893e18c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d9e4d20155164b3d9cbe4f0a893e18c7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d9e4d20155164b3d9cbe4f0a893e18c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:15:20.799185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesNegativeTest-1970665341 Jun 16 16:15:20.799185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: d9e4d20155164b3d9cbe4f0a893e18c7 Jun 16 16:15:20.799185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesNegativeTest-1970665341 Jun 16 16:15:20.799185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesNegativeTest-1970665341-project Jun 16 16:15:20.799185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:15:20.799185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:15:20.799185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: ede7cbb4890e486c8c28a0cb327db115 Jun 16 16:15:20.799185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesNegativeTest-1970665341-project Jun 16 16:15:20.799185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: Jun 16 16:15:20.799185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Volume tempest-invalid-1310864853 could not be found. Jun 16 16:15:20.799185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': 'tempest-invalid-1310864853'} Jun 16 16:15:20.799185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:15:20.800133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.800133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:15:20.800133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:15:20.800133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 16:15:20.800133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 16:15:20.800133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 16:15:20.800133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 16:15:20.800133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 16:15:20.800133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 16:15:20.800133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 16:15:20.800133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 16:15:20.800133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:15:20.800133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:15:20.800133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:15:20.800133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:15:20.800133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1310864853 could not be found. (HTTP 404) (Request-ID: req-64189a19-579e-4cf3-90d2-6111ab410afe) Jun 16 16:15:20.800133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.800133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:20.800133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.801297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.801297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 16:15:20.801297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 16:15:20.801297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:15:20.801297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:15:20.801297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:15:20.801297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:15:20.801297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:15:20.801297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:15:20.801297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:15:20.801297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:15:20.801297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 16:15:20.801297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 16:15:20.801297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 16:15:20.801297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 16:15:20.801297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 16:15:20.801297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 16:15:20.801297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 16:15:20.801297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 16:15:20.802569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:15:20.802569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:15:20.802569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:15:20.802569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:15:20.802569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1310864853 could not be found. Jun 16 16:15:20.802569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.802569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:20.802569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.802569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.802569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:20.802569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:20.802569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:15:20.802569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:15:20.802569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:15:20.802569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:15:20.802569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:15:20.802569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:15:20.802569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 16:15:20.802569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:15:20.802569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1310864853 could not be found. Jun 16 16:15:20.804132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.804132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:20.804132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.804132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.804132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:20.804132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:20.804132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:15:20.804132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:15:20.804132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1310864853 could not be found. Jun 16 16:15:20.804132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.804132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-aac4e71b-df7e-4913-be10-6d16ed084c98 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] Returning 404 to user: Volume tempest-invalid-1310864853 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:15:20.804132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-aac4e71b-df7e-4913-be10-6d16ed084c98 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1310864853" status: 404 len: 99 microversion: 2.1 time: 0.042265 Jun 16 16:15:20.804132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 206/418] 10.222.0.88 () {58 vars in 1217 bytes} [Thu Jun 16 16:15:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1310864853 => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 16 16:15:20.809108 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e35a0871-a703-432f-ac4c-5f547cbe114a tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004357 Jun 16 16:15:20.809605 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 207/419] 10.222.0.88 () {58 vars in 1139 bytes} [Thu Jun 16 16:15:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 16:15:20.819567 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6cdeaf78-3bef-40de-9e07-fda1bc1de6f6 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003666 Jun 16 16:15:20.819567 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 208/420] 10.222.0.88 () {58 vars in 1136 bytes} [Thu Jun 16 16:15:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 16 16:15:20.828480 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-65fc0858-f042-489a-8b77-0e31f3ffb851 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] Calling method '.version_select at 0x7f6f0d190550>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:20.857044 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-65fc0858-f042-489a-8b77-0e31f3ffb851 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] HTTP exception thrown: Volume 5f815b8b-7f53-4a2d-a52f-7eca76355b3a could not be found. Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-65fc0858-f042-489a-8b77-0e31f3ffb851 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] Request method failure captured: Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: DELETE /compute/v2.1/os-volumes/5f815b8b-7f53-4a2d-a52f-7eca76355b3a HTTP/1.1 Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1cYpsv7sxQso4qppDdlbaVcntQmTz7wivE_R4-1rBdgvKyBN1j0BqDAm5bixYDwIC_a8R8MmeyDj_mY5ftzpYQDBue83vBMfVb7DpI3KEhMjVkNKMKvxh91o5rlgdwJHsJ4qazq_g4d_oL7e_2xpIK9TeATJWR4CgXKq6LxDWnGfXQ Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: d9e4d20155164b3d9cbe4f0a893e18c7 Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesNegativeTest-1970665341 Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:15:20.859041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:15:20.860505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d9e4d20155164b3d9cbe4f0a893e18c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d9e4d20155164b3d9cbe4f0a893e18c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d9e4d20155164b3d9cbe4f0a893e18c7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d9e4d20155164b3d9cbe4f0a893e18c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:15:20.860505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesNegativeTest-1970665341 Jun 16 16:15:20.860505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: d9e4d20155164b3d9cbe4f0a893e18c7 Jun 16 16:15:20.860505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesNegativeTest-1970665341 Jun 16 16:15:20.860505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesNegativeTest-1970665341-project Jun 16 16:15:20.860505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:15:20.860505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:15:20.860505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: ede7cbb4890e486c8c28a0cb327db115 Jun 16 16:15:20.860505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesNegativeTest-1970665341-project Jun 16 16:15:20.860505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: Jun 16 16:15:20.860505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Volume 5f815b8b-7f53-4a2d-a52f-7eca76355b3a could not be found. Jun 16 16:15:20.860505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': '5f815b8b-7f53-4a2d-a52f-7eca76355b3a'} Jun 16 16:15:20.860505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:15:20.861402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.861402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:15:20.861402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:15:20.861402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 16:15:20.861402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 16:15:20.861402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 16:15:20.861402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 16:15:20.861402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 16:15:20.861402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 16:15:20.861402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 16:15:20.861402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 16:15:20.861402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:15:20.861402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:15:20.861402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:15:20.861402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:15:20.861402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f815b8b-7f53-4a2d-a52f-7eca76355b3a could not be found. (HTTP 404) (Request-ID: req-4657dbeb-58e4-48c7-985d-97564703e59d) Jun 16 16:15:20.861402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.861402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:20.861402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.862818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.862818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 16:15:20.862818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 16:15:20.862818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:15:20.862818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:15:20.862818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:15:20.862818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:15:20.862818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:15:20.862818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:15:20.862818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:15:20.862818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:15:20.862818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 16:15:20.862818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 16:15:20.862818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 16:15:20.862818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 16:15:20.862818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 16:15:20.862818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 16:15:20.862818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 16:15:20.862818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 16:15:20.864537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:15:20.864537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:15:20.864537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:15:20.864537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:15:20.864537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f815b8b-7f53-4a2d-a52f-7eca76355b3a could not be found. Jun 16 16:15:20.864537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.864537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:20.864537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.864537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.864537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:20.864537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:20.864537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:15:20.864537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:15:20.864537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:15:20.864537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:15:20.864537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:15:20.864537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:15:20.864537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 16:15:20.864537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:15:20.865651 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f815b8b-7f53-4a2d-a52f-7eca76355b3a could not be found. Jun 16 16:15:20.865651 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.865651 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:20.865651 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.865651 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.865651 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:20.865651 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:20.865651 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:15:20.865651 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:15:20.865651 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f815b8b-7f53-4a2d-a52f-7eca76355b3a could not be found. Jun 16 16:15:20.865651 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.865651 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-65fc0858-f042-489a-8b77-0e31f3ffb851 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] Returning 404 to user: Volume 5f815b8b-7f53-4a2d-a52f-7eca76355b3a could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:15:20.865651 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-65fc0858-f042-489a-8b77-0e31f3ffb851 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/5f815b8b-7f53-4a2d-a52f-7eca76355b3a" status: 404 len: 109 microversion: 2.1 time: 0.035835 Jun 16 16:15:20.865651 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 209/421] 10.222.0.88 () {58 vars in 1247 bytes} [Thu Jun 16 16:15:20 2022] DELETE /compute/v2.1/os-volumes/5f815b8b-7f53-4a2d-a52f-7eca76355b3a => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:15:20.870125 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-69b7819a-19e9-4133-a284-5c4cf8be39c5 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] Calling method '.version_select at 0x7f6f0d1c8b80>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:20.899728 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-69b7819a-19e9-4133-a284-5c4cf8be39c5 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] HTTP exception thrown: Volume 59336234-73e0-46af-a71c-c2bb22ea7c4f could not be found. Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-69b7819a-19e9-4133-a284-5c4cf8be39c5 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] Request method failure captured: Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/os-volumes/59336234-73e0-46af-a71c-c2bb22ea7c4f HTTP/1.1 Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1cYpsv7sxQso4qppDdlbaVcntQmTz7wivE_R4-1rBdgvKyBN1j0BqDAm5bixYDwIC_a8R8MmeyDj_mY5ftzpYQDBue83vBMfVb7DpI3KEhMjVkNKMKvxh91o5rlgdwJHsJ4qazq_g4d_oL7e_2xpIK9TeATJWR4CgXKq6LxDWnGfXQ Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: d9e4d20155164b3d9cbe4f0a893e18c7 Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesNegativeTest-1970665341 Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:15:20.901660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:15:20.903154 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d9e4d20155164b3d9cbe4f0a893e18c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d9e4d20155164b3d9cbe4f0a893e18c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d9e4d20155164b3d9cbe4f0a893e18c7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d9e4d20155164b3d9cbe4f0a893e18c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:15:20.903154 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesNegativeTest-1970665341 Jun 16 16:15:20.903154 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: d9e4d20155164b3d9cbe4f0a893e18c7 Jun 16 16:15:20.903154 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesNegativeTest-1970665341 Jun 16 16:15:20.903154 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesNegativeTest-1970665341-project Jun 16 16:15:20.903154 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:15:20.903154 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:15:20.903154 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: ede7cbb4890e486c8c28a0cb327db115 Jun 16 16:15:20.903154 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesNegativeTest-1970665341-project Jun 16 16:15:20.903154 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: Jun 16 16:15:20.903154 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Volume 59336234-73e0-46af-a71c-c2bb22ea7c4f could not be found. Jun 16 16:15:20.903154 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': '59336234-73e0-46af-a71c-c2bb22ea7c4f'} Jun 16 16:15:20.903154 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:15:20.904081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.904081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:15:20.904081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:15:20.904081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:15:20.904081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:15:20.904081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:15:20.904081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:15:20.904081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:15:20.904081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:15:20.904081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:15:20.904081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:15:20.904081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:15:20.904081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:15:20.904081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:15:20.904081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:15:20.904081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 59336234-73e0-46af-a71c-c2bb22ea7c4f could not be found. (HTTP 404) (Request-ID: req-bb938ab1-62b0-49d6-a2f9-1d4d78381d67) Jun 16 16:15:20.904081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.904081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:20.904081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.905420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.905420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 16:15:20.905420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 16:15:20.905420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:15:20.905420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:15:20.905420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:15:20.905420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:15:20.905420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:15:20.905420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:15:20.905420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:15:20.905420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:15:20.905420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:15:20.905420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:15:20.905420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:15:20.905420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:15:20.905420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:15:20.905420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:15:20.905420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:15:20.905420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:15:20.906543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:15:20.906543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:15:20.906543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:15:20.906543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:15:20.906543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 59336234-73e0-46af-a71c-c2bb22ea7c4f could not be found. Jun 16 16:15:20.906543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.906543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:20.906543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.906543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.906543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:20.906543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:20.906543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:15:20.906543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:15:20.906543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:15:20.906543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:15:20.906543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:15:20.906543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:15:20.906543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 16:15:20.906543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:15:20.907727 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 59336234-73e0-46af-a71c-c2bb22ea7c4f could not be found. Jun 16 16:15:20.907727 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.907727 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:20.907727 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.907727 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:20.907727 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:20.907727 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:20.907727 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:15:20.907727 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:15:20.907727 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 59336234-73e0-46af-a71c-c2bb22ea7c4f could not be found. Jun 16 16:15:20.907727 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:20.907727 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-69b7819a-19e9-4133-a284-5c4cf8be39c5 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] Returning 404 to user: Volume 59336234-73e0-46af-a71c-c2bb22ea7c4f could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:15:20.907727 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-69b7819a-19e9-4133-a284-5c4cf8be39c5 tempest-VolumesNegativeTest-1970665341 tempest-VolumesNegativeTest-1970665341-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/59336234-73e0-46af-a71c-c2bb22ea7c4f" status: 404 len: 109 microversion: 2.1 time: 0.036622 Jun 16 16:15:20.907727 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 210/422] 10.222.0.88 () {58 vars in 1244 bytes} [Thu Jun 16 16:15:20 2022] GET /compute/v2.1/os-volumes/59336234-73e0-46af-a71c-c2bb22ea7c4f => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:15:20.919052 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-46d6886e-e76b-46b4-9383-bf7e4c246195 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:20.926793 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-46d6886e-e76b-46b4-9383-bf7e4c246195 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1511 microversion: 2.1 time: 0.171382 Jun 16 16:15:20.927360 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 213/423] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:20 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:21.132382 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3874b3d1-6181-49f8-8eb9-8a34c05f2b9b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:21.133634 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3874b3d1-6181-49f8-8eb9-8a34c05f2b9b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:21.140847 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3874b3d1-6181-49f8-8eb9-8a34c05f2b9b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:21.141487 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3874b3d1-6181-49f8-8eb9-8a34c05f2b9b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:21.142508 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3874b3d1-6181-49f8-8eb9-8a34c05f2b9b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:21.143098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3874b3d1-6181-49f8-8eb9-8a34c05f2b9b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:21.283329 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3874b3d1-6181-49f8-8eb9-8a34c05f2b9b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:21.290917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3874b3d1-6181-49f8-8eb9-8a34c05f2b9b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.162405 Jun 16 16:15:21.291498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 211/424] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:21 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:21.540537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b385b317-08a5-4070-aa95-82ea4b1c3070 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:21.541148 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b385b317-08a5-4070-aa95-82ea4b1c3070 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:21.547253 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b385b317-08a5-4070-aa95-82ea4b1c3070 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:21.547712 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b385b317-08a5-4070-aa95-82ea4b1c3070 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:21.548392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b385b317-08a5-4070-aa95-82ea4b1c3070 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:21.548831 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b385b317-08a5-4070-aa95-82ea4b1c3070 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:21.690364 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b385b317-08a5-4070-aa95-82ea4b1c3070 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:21.698401 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b385b317-08a5-4070-aa95-82ea4b1c3070 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.162220 Jun 16 16:15:21.698970 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 214/425] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:21 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:21.945555 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2fa7f749-adff-4f40-941f-2a4f5d05d430 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:21.946298 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2fa7f749-adff-4f40-941f-2a4f5d05d430 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:21.952895 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2fa7f749-adff-4f40-941f-2a4f5d05d430 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:21.953357 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2fa7f749-adff-4f40-941f-2a4f5d05d430 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:21.954161 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2fa7f749-adff-4f40-941f-2a4f5d05d430 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:21.954608 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2fa7f749-adff-4f40-941f-2a4f5d05d430 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:22.103490 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2fa7f749-adff-4f40-941f-2a4f5d05d430 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:22.111135 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2fa7f749-adff-4f40-941f-2a4f5d05d430 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1511 microversion: 2.1 time: 0.169356 Jun 16 16:15:22.111698 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 212/426] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:21 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:22.307805 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-188629dc-40be-485a-854a-92c4351d947e tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:22.308476 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-188629dc-40be-485a-854a-92c4351d947e tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:22.314506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-188629dc-40be-485a-854a-92c4351d947e tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:22.314953 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-188629dc-40be-485a-854a-92c4351d947e tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:22.315710 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-188629dc-40be-485a-854a-92c4351d947e tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:22.316333 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-188629dc-40be-485a-854a-92c4351d947e tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:22.461265 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-188629dc-40be-485a-854a-92c4351d947e tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:22.468936 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-188629dc-40be-485a-854a-92c4351d947e tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.165263 Jun 16 16:15:22.469514 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 215/427] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:22 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:22.715299 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0a92189b-986e-404d-8084-2c3e6d58fbaa tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:22.715917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0a92189b-986e-404d-8084-2c3e6d58fbaa tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:22.721985 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0a92189b-986e-404d-8084-2c3e6d58fbaa tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:22.722693 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0a92189b-986e-404d-8084-2c3e6d58fbaa tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:22.723470 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0a92189b-986e-404d-8084-2c3e6d58fbaa tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:22.723904 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0a92189b-986e-404d-8084-2c3e6d58fbaa tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:22.865995 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0a92189b-986e-404d-8084-2c3e6d58fbaa tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:22.874315 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0a92189b-986e-404d-8084-2c3e6d58fbaa tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.163397 Jun 16 16:15:22.874941 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 213/428] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:22 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:23.128357 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-114ae8f4-14fd-4686-9d38-9f4590bcb647 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:23.132312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-114ae8f4-14fd-4686-9d38-9f4590bcb647 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:23.136375 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-114ae8f4-14fd-4686-9d38-9f4590bcb647 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:23.136844 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-114ae8f4-14fd-4686-9d38-9f4590bcb647 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:23.138079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-114ae8f4-14fd-4686-9d38-9f4590bcb647 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:23.138644 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-114ae8f4-14fd-4686-9d38-9f4590bcb647 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:23.143164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:23.285212 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-114ae8f4-14fd-4686-9d38-9f4590bcb647 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:23.297747 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-114ae8f4-14fd-4686-9d38-9f4590bcb647 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1511 microversion: 2.1 time: 0.170627 Jun 16 16:15:23.297747 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 216/429] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:23 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:23.485910 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0798fc05-707e-4112-bb05-1f307ece957d tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:23.486808 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0798fc05-707e-4112-bb05-1f307ece957d tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:23.496999 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0798fc05-707e-4112-bb05-1f307ece957d tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:23.497528 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0798fc05-707e-4112-bb05-1f307ece957d tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:23.498425 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0798fc05-707e-4112-bb05-1f307ece957d tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:23.498852 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0798fc05-707e-4112-bb05-1f307ece957d tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:23.640520 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0798fc05-707e-4112-bb05-1f307ece957d tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:23.648564 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0798fc05-707e-4112-bb05-1f307ece957d tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.165997 Jun 16 16:15:23.649143 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 214/430] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:23 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:23.890810 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-800a13ac-748e-4a22-9355-9d3d764c730a tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:23.891402 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-800a13ac-748e-4a22-9355-9d3d764c730a tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:23.897553 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-800a13ac-748e-4a22-9355-9d3d764c730a tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:23.898150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-800a13ac-748e-4a22-9355-9d3d764c730a tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:23.899441 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-800a13ac-748e-4a22-9355-9d3d764c730a tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:23.899866 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-800a13ac-748e-4a22-9355-9d3d764c730a tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:24.069759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-800a13ac-748e-4a22-9355-9d3d764c730a tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:24.080169 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-800a13ac-748e-4a22-9355-9d3d764c730a tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.193059 Jun 16 16:15:24.081275 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 217/431] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:23 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:24.311703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cf90f207-bdd6-4b11-a8e7-2281313231a9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:24.312317 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-cf90f207-bdd6-4b11-a8e7-2281313231a9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:24.318559 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cf90f207-bdd6-4b11-a8e7-2281313231a9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:24.319008 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cf90f207-bdd6-4b11-a8e7-2281313231a9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:24.319775 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cf90f207-bdd6-4b11-a8e7-2281313231a9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:24.320261 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cf90f207-bdd6-4b11-a8e7-2281313231a9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:24.515854 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cf90f207-bdd6-4b11-a8e7-2281313231a9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:24.524403 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-cf90f207-bdd6-4b11-a8e7-2281313231a9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1511 microversion: 2.1 time: 0.216445 Jun 16 16:15:24.524988 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 215/432] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:24 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1511 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:24.664882 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7120bea6-d811-428c-9338-92bce5360eb0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:24.665498 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7120bea6-d811-428c-9338-92bce5360eb0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:24.675453 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7120bea6-d811-428c-9338-92bce5360eb0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:24.676245 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7120bea6-d811-428c-9338-92bce5360eb0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:24.677839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7120bea6-d811-428c-9338-92bce5360eb0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:24.678444 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7120bea6-d811-428c-9338-92bce5360eb0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:24.822469 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7120bea6-d811-428c-9338-92bce5360eb0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:24.830221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7120bea6-d811-428c-9338-92bce5360eb0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.169584 Jun 16 16:15:24.830924 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 218/433] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:24 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:25.098958 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4a455c62-9766-4590-976a-0c8b1c926507 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:25.099679 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4a455c62-9766-4590-976a-0c8b1c926507 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:25.106558 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4a455c62-9766-4590-976a-0c8b1c926507 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:25.107031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4a455c62-9766-4590-976a-0c8b1c926507 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:25.107800 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4a455c62-9766-4590-976a-0c8b1c926507 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:25.108234 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4a455c62-9766-4590-976a-0c8b1c926507 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:25.251318 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4a455c62-9766-4590-976a-0c8b1c926507 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:25.258920 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4a455c62-9766-4590-976a-0c8b1c926507 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.164157 Jun 16 16:15:25.259489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 216/434] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:25 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:25.541026 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-14d5af69-94ce-4776-a236-4520cd8f6a42 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:25.541675 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-14d5af69-94ce-4776-a236-4520cd8f6a42 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:25.547781 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-14d5af69-94ce-4776-a236-4520cd8f6a42 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:25.548230 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-14d5af69-94ce-4776-a236-4520cd8f6a42 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:25.548986 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-14d5af69-94ce-4776-a236-4520cd8f6a42 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:25.549428 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-14d5af69-94ce-4776-a236-4520cd8f6a42 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:25.693472 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-14d5af69-94ce-4776-a236-4520cd8f6a42 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:25.701550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-14d5af69-94ce-4776-a236-4520cd8f6a42 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1511 microversion: 2.1 time: 0.164834 Jun 16 16:15:25.702207 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 219/435] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:25 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:25.848137 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6e9df936-0426-4487-9ecd-603b5db2b538 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:25.848758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6e9df936-0426-4487-9ecd-603b5db2b538 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:25.855806 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6e9df936-0426-4487-9ecd-603b5db2b538 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:25.856263 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6e9df936-0426-4487-9ecd-603b5db2b538 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:25.857046 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6e9df936-0426-4487-9ecd-603b5db2b538 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:25.857488 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6e9df936-0426-4487-9ecd-603b5db2b538 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:26.277098 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bdd12c68-5884-4dc2-846c-d625c0790b2c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:26.278061 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-bdd12c68-5884-4dc2-846c-d625c0790b2c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:26.286802 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bdd12c68-5884-4dc2-846c-d625c0790b2c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:26.287783 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bdd12c68-5884-4dc2-846c-d625c0790b2c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:26.288872 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bdd12c68-5884-4dc2-846c-d625c0790b2c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:26.289559 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bdd12c68-5884-4dc2-846c-d625c0790b2c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:26.311908 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6e9df936-0426-4487-9ecd-603b5db2b538 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:26.324316 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6e9df936-0426-4487-9ecd-603b5db2b538 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.480129 Jun 16 16:15:26.333462 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 217/436] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:25 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:26.450417 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bdd12c68-5884-4dc2-846c-d625c0790b2c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:26.458301 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-bdd12c68-5884-4dc2-846c-d625c0790b2c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.185703 Jun 16 16:15:26.458857 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 220/437] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:26 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:26.719418 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-39624f92-26a2-452c-b662-d43b84167cd9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:26.720030 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-39624f92-26a2-452c-b662-d43b84167cd9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:26.733758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-39624f92-26a2-452c-b662-d43b84167cd9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:26.734263 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-39624f92-26a2-452c-b662-d43b84167cd9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:26.735205 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-39624f92-26a2-452c-b662-d43b84167cd9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:26.735591 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-39624f92-26a2-452c-b662-d43b84167cd9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:26.892579 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-39624f92-26a2-452c-b662-d43b84167cd9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:26.903900 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-39624f92-26a2-452c-b662-d43b84167cd9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1511 microversion: 2.1 time: 0.188150 Jun 16 16:15:26.904485 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 218/438] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:26 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1511 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:27.343318 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7512be00-1829-4d4e-8d94-23b3775aa3f7 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:27.344675 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7512be00-1829-4d4e-8d94-23b3775aa3f7 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:27.352761 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7512be00-1829-4d4e-8d94-23b3775aa3f7 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:27.353460 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7512be00-1829-4d4e-8d94-23b3775aa3f7 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:27.354456 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7512be00-1829-4d4e-8d94-23b3775aa3f7 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:27.354948 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7512be00-1829-4d4e-8d94-23b3775aa3f7 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:27.476102 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d32878d9-f2a4-4110-92ab-2b389bd088b0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:27.477964 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d32878d9-f2a4-4110-92ab-2b389bd088b0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:27.486264 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d32878d9-f2a4-4110-92ab-2b389bd088b0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:27.486870 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d32878d9-f2a4-4110-92ab-2b389bd088b0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:27.488004 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d32878d9-f2a4-4110-92ab-2b389bd088b0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:27.488613 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d32878d9-f2a4-4110-92ab-2b389bd088b0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:27.510614 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7512be00-1829-4d4e-8d94-23b3775aa3f7 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:27.518019 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7512be00-1829-4d4e-8d94-23b3775aa3f7 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.180935 Jun 16 16:15:27.518595 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 221/439] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:27 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:27.631764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d32878d9-f2a4-4110-92ab-2b389bd088b0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:27.640892 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d32878d9-f2a4-4110-92ab-2b389bd088b0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.169319 Jun 16 16:15:27.641475 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 219/440] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:27 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:27.920797 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2a59d9cd-ea62-42d3-bd9f-2f1656c2dd27 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:27.921689 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2a59d9cd-ea62-42d3-bd9f-2f1656c2dd27 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:27.931333 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2a59d9cd-ea62-42d3-bd9f-2f1656c2dd27 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:27.931748 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2a59d9cd-ea62-42d3-bd9f-2f1656c2dd27 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:27.932522 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2a59d9cd-ea62-42d3-bd9f-2f1656c2dd27 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:27.932963 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2a59d9cd-ea62-42d3-bd9f-2f1656c2dd27 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:28.083462 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2a59d9cd-ea62-42d3-bd9f-2f1656c2dd27 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:28.092080 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2a59d9cd-ea62-42d3-bd9f-2f1656c2dd27 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1511 microversion: 2.1 time: 0.175085 Jun 16 16:15:28.092654 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 222/441] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:27 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:28.535599 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8425bf94-f546-4db3-8334-93e7afb9a368 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:28.536437 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8425bf94-f546-4db3-8334-93e7afb9a368 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:28.542597 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8425bf94-f546-4db3-8334-93e7afb9a368 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:28.543042 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8425bf94-f546-4db3-8334-93e7afb9a368 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:28.543983 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8425bf94-f546-4db3-8334-93e7afb9a368 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:28.544583 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8425bf94-f546-4db3-8334-93e7afb9a368 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:28.659002 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8ee5d1ea-6c20-440f-860b-64378cb53fd4 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:28.660778 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8ee5d1ea-6c20-440f-860b-64378cb53fd4 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:28.669781 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8ee5d1ea-6c20-440f-860b-64378cb53fd4 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:28.669781 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8ee5d1ea-6c20-440f-860b-64378cb53fd4 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:28.670505 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8ee5d1ea-6c20-440f-860b-64378cb53fd4 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:28.671508 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8ee5d1ea-6c20-440f-860b-64378cb53fd4 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:28.691277 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8425bf94-f546-4db3-8334-93e7afb9a368 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:28.699450 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8425bf94-f546-4db3-8334-93e7afb9a368 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.168207 Jun 16 16:15:28.700660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 220/442] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:28 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:28.820093 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8ee5d1ea-6c20-440f-860b-64378cb53fd4 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:28.827559 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8ee5d1ea-6c20-440f-860b-64378cb53fd4 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.173396 Jun 16 16:15:28.828123 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 223/443] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:28 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:29.112461 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-07c1fe06-adb0-4cfb-8993-b0cfa4d56574 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:29.114098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-07c1fe06-adb0-4cfb-8993-b0cfa4d56574 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:29.125525 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-07c1fe06-adb0-4cfb-8993-b0cfa4d56574 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:29.126188 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-07c1fe06-adb0-4cfb-8993-b0cfa4d56574 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:29.127079 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-07c1fe06-adb0-4cfb-8993-b0cfa4d56574 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:29.127626 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-07c1fe06-adb0-4cfb-8993-b0cfa4d56574 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:29.308043 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-07c1fe06-adb0-4cfb-8993-b0cfa4d56574 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:29.315711 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-07c1fe06-adb0-4cfb-8993-b0cfa4d56574 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1511 microversion: 2.1 time: 0.209194 Jun 16 16:15:29.316220 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 221/444] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:29 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1511 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:29.716831 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f6f9908e-9fa5-4b9a-bb99-8cd708d437c9 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:29.717441 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f6f9908e-9fa5-4b9a-bb99-8cd708d437c9 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:29.723892 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f6f9908e-9fa5-4b9a-bb99-8cd708d437c9 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:29.724335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f6f9908e-9fa5-4b9a-bb99-8cd708d437c9 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:29.725332 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f6f9908e-9fa5-4b9a-bb99-8cd708d437c9 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:29.725794 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f6f9908e-9fa5-4b9a-bb99-8cd708d437c9 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:29.845428 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d53e4996-dd77-42f0-83f4-8d345bba0ce6 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:29.846073 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d53e4996-dd77-42f0-83f4-8d345bba0ce6 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:29.852745 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d53e4996-dd77-42f0-83f4-8d345bba0ce6 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:29.853199 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d53e4996-dd77-42f0-83f4-8d345bba0ce6 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:29.854010 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d53e4996-dd77-42f0-83f4-8d345bba0ce6 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:29.854448 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d53e4996-dd77-42f0-83f4-8d345bba0ce6 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:29.859061 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f6f9908e-9fa5-4b9a-bb99-8cd708d437c9 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:29.866766 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f6f9908e-9fa5-4b9a-bb99-8cd708d437c9 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.153579 Jun 16 16:15:29.875860 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 224/445] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:29 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:29.992926 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d53e4996-dd77-42f0-83f4-8d345bba0ce6 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:30.001338 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d53e4996-dd77-42f0-83f4-8d345bba0ce6 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.159653 Jun 16 16:15:30.002205 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 222/446] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:29 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:30.333558 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-645eb85e-e7a0-4700-b6eb-29c582135043 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:30.334222 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-645eb85e-e7a0-4700-b6eb-29c582135043 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:30.341140 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-645eb85e-e7a0-4700-b6eb-29c582135043 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:30.341592 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-645eb85e-e7a0-4700-b6eb-29c582135043 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:30.342545 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-645eb85e-e7a0-4700-b6eb-29c582135043 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:30.342985 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-645eb85e-e7a0-4700-b6eb-29c582135043 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:30.575626 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-645eb85e-e7a0-4700-b6eb-29c582135043 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:30.583559 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-645eb85e-e7a0-4700-b6eb-29c582135043 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1511 microversion: 2.1 time: 0.254400 Jun 16 16:15:30.584135 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 225/447] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:30 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1511 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:30.885379 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a69d1453-1f2f-467d-aca2-1653646e436f tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:30.886859 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a69d1453-1f2f-467d-aca2-1653646e436f tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:30.894086 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a69d1453-1f2f-467d-aca2-1653646e436f tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:30.894543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a69d1453-1f2f-467d-aca2-1653646e436f tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:30.895372 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a69d1453-1f2f-467d-aca2-1653646e436f tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:30.895974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a69d1453-1f2f-467d-aca2-1653646e436f tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:31.019418 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f9cc3786-fdd7-4b5a-80d6-2c6bbd940845 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:31.020579 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f9cc3786-fdd7-4b5a-80d6-2c6bbd940845 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:31.026964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f9cc3786-fdd7-4b5a-80d6-2c6bbd940845 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:31.027418 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f9cc3786-fdd7-4b5a-80d6-2c6bbd940845 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:31.028188 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f9cc3786-fdd7-4b5a-80d6-2c6bbd940845 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:31.028626 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f9cc3786-fdd7-4b5a-80d6-2c6bbd940845 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:31.214300 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a69d1453-1f2f-467d-aca2-1653646e436f tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:31.222729 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a69d1453-1f2f-467d-aca2-1653646e436f tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.342507 Jun 16 16:15:31.223690 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 223/448] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:30 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:31.301201 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f9cc3786-fdd7-4b5a-80d6-2c6bbd940845 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:31.311214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f9cc3786-fdd7-4b5a-80d6-2c6bbd940845 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.295959 Jun 16 16:15:31.311832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 226/449] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:31 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:31.616642 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8bff4db9-409f-43e5-9328-3a12325d91f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:31.618149 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a31df46c-bf18-4593-a5c6-4d70f76b233e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ce9c1a8-3aac-469f-854d-bddc2f835cee", "device": "/dev/sdb"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:31.619055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8bff4db9-409f-43e5-9328-3a12325d91f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:31.626687 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a31df46c-bf18-4593-a5c6-4d70f76b233e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:31.646208 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8bff4db9-409f-43e5-9328-3a12325d91f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:31.646465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a31df46c-bf18-4593-a5c6-4d70f76b233e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:31.646664 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8bff4db9-409f-43e5-9328-3a12325d91f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:31.647042 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a31df46c-bf18-4593-a5c6-4d70f76b233e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:31.647816 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a31df46c-bf18-4593-a5c6-4d70f76b233e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:31.648305 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8bff4db9-409f-43e5-9328-3a12325d91f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:31.648796 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a31df46c-bf18-4593-a5c6-4d70f76b233e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:31.649103 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8bff4db9-409f-43e5-9328-3a12325d91f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:31.914926 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8bff4db9-409f-43e5-9328-3a12325d91f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:31.919584 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=100 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:31.926507 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8bff4db9-409f-43e5-9328-3a12325d91f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1511 microversion: 2.1 time: 0.322003 Jun 16 16:15:31.927049 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 224/450] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:31 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1511 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:32.240568 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b5a046c3-708e-439f-9440-24adc8090482 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:32.241221 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b5a046c3-708e-439f-9440-24adc8090482 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:32.250269 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b5a046c3-708e-439f-9440-24adc8090482 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:32.250729 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b5a046c3-708e-439f-9440-24adc8090482 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:32.251519 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b5a046c3-708e-439f-9440-24adc8090482 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:32.251961 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b5a046c3-708e-439f-9440-24adc8090482 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:32.659689 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b5a046c3-708e-439f-9440-24adc8090482 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:32.671461 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b5a046c3-708e-439f-9440-24adc8090482 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.434860 Jun 16 16:15:32.672084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 225/451] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:32 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:32.686861 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9cbbde6b-f90f-4128-b8ef-313a5ef29abf tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:32.687915 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9cbbde6b-f90f-4128-b8ef-313a5ef29abf tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:32.696060 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9cbbde6b-f90f-4128-b8ef-313a5ef29abf tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:32.696751 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9cbbde6b-f90f-4128-b8ef-313a5ef29abf tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:32.697804 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9cbbde6b-f90f-4128-b8ef-313a5ef29abf tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:32.698491 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9cbbde6b-f90f-4128-b8ef-313a5ef29abf tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:32.923000 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9cbbde6b-f90f-4128-b8ef-313a5ef29abf tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:32.931442 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9cbbde6b-f90f-4128-b8ef-313a5ef29abf tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.249219 Jun 16 16:15:32.933266 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 226/452] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:32 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:32.946698 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b265a167-3b69-4189-ab24-9ce95ca890dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:32.947659 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b265a167-3b69-4189-ab24-9ce95ca890dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:32.955193 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b265a167-3b69-4189-ab24-9ce95ca890dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:32.956145 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b265a167-3b69-4189-ab24-9ce95ca890dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:32.957171 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b265a167-3b69-4189-ab24-9ce95ca890dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:32.957849 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b265a167-3b69-4189-ab24-9ce95ca890dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:33.431181 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a31df46c-bf18-4593-a5c6-4d70f76b233e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "POST /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.827456 Jun 16 16:15:33.431898 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 227/453] 10.222.0.88 () {60 vars in 1322 bytes} [Thu Jun 16 16:15:31 2022] POST /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61/os-volume_attachments => generated 194 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:33.557346 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b265a167-3b69-4189-ab24-9ce95ca890dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:33.565890 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b265a167-3b69-4189-ab24-9ce95ca890dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1511 microversion: 2.1 time: 0.623097 Jun 16 16:15:33.569291 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 227/454] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:32 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1511 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:33.708812 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5cbe671c-deff-4a25-a67d-04db4069f86b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:33.709832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5cbe671c-deff-4a25-a67d-04db4069f86b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:33.719295 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5cbe671c-deff-4a25-a67d-04db4069f86b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:33.719750 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5cbe671c-deff-4a25-a67d-04db4069f86b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:33.720532 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5cbe671c-deff-4a25-a67d-04db4069f86b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:33.720972 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5cbe671c-deff-4a25-a67d-04db4069f86b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:33.956255 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0a831a4b-a89a-416a-8afb-3c84a3d0dd0c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:33.958200 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0a831a4b-a89a-416a-8afb-3c84a3d0dd0c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:33.974561 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0a831a4b-a89a-416a-8afb-3c84a3d0dd0c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:33.975208 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0a831a4b-a89a-416a-8afb-3c84a3d0dd0c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:33.989231 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0a831a4b-a89a-416a-8afb-3c84a3d0dd0c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:33.990381 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0a831a4b-a89a-416a-8afb-3c84a3d0dd0c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:34.590372 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5cbe671c-deff-4a25-a67d-04db4069f86b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:34.613094 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5cbe671c-deff-4a25-a67d-04db4069f86b tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.928055 Jun 16 16:15:34.617434 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 228/455] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:33 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:34.631629 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-59864c34-c369-4894-a255-ffa41397d5bd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:34.634767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-59864c34-c369-4894-a255-ffa41397d5bd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:34.645344 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-59864c34-c369-4894-a255-ffa41397d5bd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:34.646076 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-59864c34-c369-4894-a255-ffa41397d5bd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:34.647197 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-59864c34-c369-4894-a255-ffa41397d5bd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:34.649276 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-59864c34-c369-4894-a255-ffa41397d5bd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:34.853958 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0a831a4b-a89a-416a-8afb-3c84a3d0dd0c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:34.870973 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0a831a4b-a89a-416a-8afb-3c84a3d0dd0c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.925847 Jun 16 16:15:34.871899 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 228/456] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:33 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:35.125350 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-59864c34-c369-4894-a255-ffa41397d5bd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:35.147346 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-59864c34-c369-4894-a255-ffa41397d5bd tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1511 microversion: 2.1 time: 0.526114 Jun 16 16:15:35.159260 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 229/457] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:34 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1511 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:35.524541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-cbd0c8be-2c68-4950-8b89-634020038c30 req-9d352e74-abf2-4cbb-82eb-082a5b29af9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c", "name": "network-vif-plugged", "status": "completed", "tag": "c757db64-168f-46a4-8d08-d52739845f89"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:35.545712 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-cbd0c8be-2c68-4950-8b89-634020038c30 req-9d352e74-abf2-4cbb-82eb-082a5b29af9f service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:35.546175 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-cbd0c8be-2c68-4950-8b89-634020038c30 req-9d352e74-abf2-4cbb-82eb-082a5b29af9f service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:35.578949 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-cbd0c8be-2c68-4950-8b89-634020038c30 req-9d352e74-abf2-4cbb-82eb-082a5b29af9f service nova] Creating event network-vif-plugged:c757db64-168f-46a4-8d08-d52739845f89 for instance f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c on hv-cinder-83735 Jun 16 16:15:35.588400 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-cbd0c8be-2c68-4950-8b89-634020038c30 req-9d352e74-abf2-4cbb-82eb-082a5b29af9f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068732 Jun 16 16:15:35.589012 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 229/458] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:35.675397 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fb8c9193-ea99-48b3-907b-df933a7dba58 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:35.677971 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fb8c9193-ea99-48b3-907b-df933a7dba58 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:35.688578 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fb8c9193-ea99-48b3-907b-df933a7dba58 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:35.689250 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fb8c9193-ea99-48b3-907b-df933a7dba58 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:35.690325 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fb8c9193-ea99-48b3-907b-df933a7dba58 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:35.690948 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fb8c9193-ea99-48b3-907b-df933a7dba58 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:35.890448 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-99d836d8-ca5f-4296-8d4b-b2d2ecb549b8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:35.891650 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-99d836d8-ca5f-4296-8d4b-b2d2ecb549b8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:35.900239 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-99d836d8-ca5f-4296-8d4b-b2d2ecb549b8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:35.900976 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-99d836d8-ca5f-4296-8d4b-b2d2ecb549b8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:35.902236 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-99d836d8-ca5f-4296-8d4b-b2d2ecb549b8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:35.908109 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-99d836d8-ca5f-4296-8d4b-b2d2ecb549b8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:36.030712 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fb8c9193-ea99-48b3-907b-df933a7dba58 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:36.043474 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fb8c9193-ea99-48b3-907b-df933a7dba58 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.397312 Jun 16 16:15:36.044305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 230/459] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:35 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:36.167094 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ac2903e7-2db2-4cab-9072-2a88e5ceff1c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:36.168372 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ac2903e7-2db2-4cab-9072-2a88e5ceff1c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:36.176609 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ac2903e7-2db2-4cab-9072-2a88e5ceff1c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:36.177440 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ac2903e7-2db2-4cab-9072-2a88e5ceff1c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:36.178740 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ac2903e7-2db2-4cab-9072-2a88e5ceff1c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:36.179468 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-99d836d8-ca5f-4296-8d4b-b2d2ecb549b8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:36.179640 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ac2903e7-2db2-4cab-9072-2a88e5ceff1c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:36.195866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-99d836d8-ca5f-4296-8d4b-b2d2ecb549b8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.310947 Jun 16 16:15:36.210585 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 230/460] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:35 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:36.223424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:36.387511 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ac2903e7-2db2-4cab-9072-2a88e5ceff1c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:36.396455 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ac2903e7-2db2-4cab-9072-2a88e5ceff1c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1511 microversion: 2.1 time: 0.234648 Jun 16 16:15:36.400206 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 231/461] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:36 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1511 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:37.071647 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-71ab3f76-4132-438c-83ba-b1317d8d14fc tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:37.076363 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-71ab3f76-4132-438c-83ba-b1317d8d14fc tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:37.091789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-71ab3f76-4132-438c-83ba-b1317d8d14fc tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:37.092249 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-71ab3f76-4132-438c-83ba-b1317d8d14fc tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:37.093035 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-71ab3f76-4132-438c-83ba-b1317d8d14fc tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:37.093488 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-71ab3f76-4132-438c-83ba-b1317d8d14fc tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:37.231296 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-eb9cd3e1-400b-4401-949b-dc253e7f8793 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:37.231970 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-eb9cd3e1-400b-4401-949b-dc253e7f8793 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:37.239518 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb9cd3e1-400b-4401-949b-dc253e7f8793 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:37.240169 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb9cd3e1-400b-4401-949b-dc253e7f8793 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:37.241144 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb9cd3e1-400b-4401-949b-dc253e7f8793 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:37.241633 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb9cd3e1-400b-4401-949b-dc253e7f8793 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:37.312288 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-71ab3f76-4132-438c-83ba-b1317d8d14fc tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:37.326462 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-71ab3f76-4132-438c-83ba-b1317d8d14fc tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.259264 Jun 16 16:15:37.327041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 231/462] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:37 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:37.416649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2f2cdc3c-e118-4fb8-9df1-87823cbc077d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:37.417489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2f2cdc3c-e118-4fb8-9df1-87823cbc077d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:37.426920 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2f2cdc3c-e118-4fb8-9df1-87823cbc077d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:37.427380 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2f2cdc3c-e118-4fb8-9df1-87823cbc077d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:37.428167 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2f2cdc3c-e118-4fb8-9df1-87823cbc077d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:37.430812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2f2cdc3c-e118-4fb8-9df1-87823cbc077d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:37.454170 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-eb9cd3e1-400b-4401-949b-dc253e7f8793 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:37.463135 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-eb9cd3e1-400b-4401-949b-dc253e7f8793 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.244750 Jun 16 16:15:37.464576 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 232/463] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:37 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:37.658145 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2f2cdc3c-e118-4fb8-9df1-87823cbc077d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:37.676065 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2f2cdc3c-e118-4fb8-9df1-87823cbc077d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1511 microversion: 2.1 time: 0.262858 Jun 16 16:15:37.678148 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 232/464] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:37 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1511 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:38.343120 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7eb78106-e96c-4fd0-bfda-117bd0345415 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:38.343903 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7eb78106-e96c-4fd0-bfda-117bd0345415 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:38.352544 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7eb78106-e96c-4fd0-bfda-117bd0345415 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:38.352750 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7eb78106-e96c-4fd0-bfda-117bd0345415 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:38.353608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7eb78106-e96c-4fd0-bfda-117bd0345415 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:38.354513 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7eb78106-e96c-4fd0-bfda-117bd0345415 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:38.481696 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-db00f7df-4320-4154-96e8-f3bd0c033e19 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:38.482460 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-db00f7df-4320-4154-96e8-f3bd0c033e19 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:38.504219 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-db00f7df-4320-4154-96e8-f3bd0c033e19 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:38.505446 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-db00f7df-4320-4154-96e8-f3bd0c033e19 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:38.519212 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-db00f7df-4320-4154-96e8-f3bd0c033e19 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:38.521903 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-db00f7df-4320-4154-96e8-f3bd0c033e19 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:38.693877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7eb78106-e96c-4fd0-bfda-117bd0345415 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:38.707527 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7eb78106-e96c-4fd0-bfda-117bd0345415 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.362680 Jun 16 16:15:38.709283 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 233/465] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:38 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:38.720774 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f79fced1-0b47-4d83-877b-ca8db3dfecb5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:38.721636 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f79fced1-0b47-4d83-877b-ca8db3dfecb5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:38.728780 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=82 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:38.730589 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f79fced1-0b47-4d83-877b-ca8db3dfecb5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:38.731217 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f79fced1-0b47-4d83-877b-ca8db3dfecb5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:38.732145 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f79fced1-0b47-4d83-877b-ca8db3dfecb5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:38.732730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f79fced1-0b47-4d83-877b-ca8db3dfecb5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:38.949687 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-db00f7df-4320-4154-96e8-f3bd0c033e19 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:38.960980 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-db00f7df-4320-4154-96e8-f3bd0c033e19 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.484218 Jun 16 16:15:38.962432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 233/466] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:38 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:38.998503 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f79fced1-0b47-4d83-877b-ca8db3dfecb5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:39.022967 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f79fced1-0b47-4d83-877b-ca8db3dfecb5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1517 microversion: 2.1 time: 0.312157 Jun 16 16:15:39.023876 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 234/467] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:38 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1517 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:39.729750 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-bf82c63b-588a-4f06-8c4a-ba67653c84ec tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:39.730372 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-bf82c63b-588a-4f06-8c4a-ba67653c84ec tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:39.750789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bf82c63b-588a-4f06-8c4a-ba67653c84ec tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:39.751256 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bf82c63b-588a-4f06-8c4a-ba67653c84ec tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:39.754225 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bf82c63b-588a-4f06-8c4a-ba67653c84ec tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:39.754884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bf82c63b-588a-4f06-8c4a-ba67653c84ec tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:39.978382 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a7ab24fc-dd33-4128-9914-f2b62cbad7cc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:39.978966 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a7ab24fc-dd33-4128-9914-f2b62cbad7cc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:39.992163 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a7ab24fc-dd33-4128-9914-f2b62cbad7cc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:39.992616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a7ab24fc-dd33-4128-9914-f2b62cbad7cc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:39.993478 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a7ab24fc-dd33-4128-9914-f2b62cbad7cc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:39.993939 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a7ab24fc-dd33-4128-9914-f2b62cbad7cc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:40.058715 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-bf82c63b-588a-4f06-8c4a-ba67653c84ec tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:40.070523 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-bf82c63b-588a-4f06-8c4a-ba67653c84ec tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1314 microversion: 2.1 time: 0.341318 Jun 16 16:15:40.074989 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 234/468] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:39 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:40.458011 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a7ab24fc-dd33-4128-9914-f2b62cbad7cc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:40.470799 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a7ab24fc-dd33-4128-9914-f2b62cbad7cc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.495530 Jun 16 16:15:40.477521 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 235/469] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:39 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:41.092521 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8ef1eda9-d2b8-4a68-8092-86dc7e604b72 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:41.093800 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8ef1eda9-d2b8-4a68-8092-86dc7e604b72 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:41.101995 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=76 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:41.103925 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8ef1eda9-d2b8-4a68-8092-86dc7e604b72 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:41.105121 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8ef1eda9-d2b8-4a68-8092-86dc7e604b72 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:41.106697 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8ef1eda9-d2b8-4a68-8092-86dc7e604b72 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:41.107333 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8ef1eda9-d2b8-4a68-8092-86dc7e604b72 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:41.278422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8ef1eda9-d2b8-4a68-8092-86dc7e604b72 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:41.286205 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8ef1eda9-d2b8-4a68-8092-86dc7e604b72 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1464 microversion: 2.1 time: 0.201899 Jun 16 16:15:41.286771 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 235/470] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:41 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1464 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:41.326345 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-44ec7a39-b46a-484c-83be-032027f75041 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:41.327559 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-44ec7a39-b46a-484c-83be-032027f75041 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:41.334926 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-44ec7a39-b46a-484c-83be-032027f75041 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:41.336217 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-44ec7a39-b46a-484c-83be-032027f75041 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:41.337260 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-44ec7a39-b46a-484c-83be-032027f75041 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:41.337916 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-44ec7a39-b46a-484c-83be-032027f75041 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:41.366506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-44ec7a39-b46a-484c-83be-032027f75041 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:15:41.497420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b9d68b8d-5ad9-4e1c-a98a-d9ee92fc0b06 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:41.498404 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b9d68b8d-5ad9-4e1c-a98a-d9ee92fc0b06 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:41.506551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b9d68b8d-5ad9-4e1c-a98a-d9ee92fc0b06 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:41.508798 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-44ec7a39-b46a-484c-83be-032027f75041 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "DELETE /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 204 len: 0 microversion: 2.1 time: 0.186293 Jun 16 16:15:41.509601 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 236/471] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:15:41 2022] DELETE /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:15:41.510634 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b9d68b8d-5ad9-4e1c-a98a-d9ee92fc0b06 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:41.511625 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b9d68b8d-5ad9-4e1c-a98a-d9ee92fc0b06 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:41.512214 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b9d68b8d-5ad9-4e1c-a98a-d9ee92fc0b06 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:41.519880 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-76b16b22-7cea-42ca-bd3a-03d5d4159c87 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:41.524359 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-76b16b22-7cea-42ca-bd3a-03d5d4159c87 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:41.539420 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-76b16b22-7cea-42ca-bd3a-03d5d4159c87 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:41.540125 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-76b16b22-7cea-42ca-bd3a-03d5d4159c87 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:41.544993 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-76b16b22-7cea-42ca-bd3a-03d5d4159c87 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:41.545618 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-76b16b22-7cea-42ca-bd3a-03d5d4159c87 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:42.126535 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-76b16b22-7cea-42ca-bd3a-03d5d4159c87 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:42.140953 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-76b16b22-7cea-42ca-bd3a-03d5d4159c87 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1470 microversion: 2.1 time: 0.626236 Jun 16 16:15:42.141799 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 237/472] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:41 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1470 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:42.150955 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b9d68b8d-5ad9-4e1c-a98a-d9ee92fc0b06 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:42.158428 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cffc6e2a-fae5-400e-87e1-19a45b94533b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Action: 'create', calling method: .version_select at 0x7f6f0d2e23a0>, body: {"keypair": {"name": "tempest-keypair-748128690", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiUqLWiejTi9NsjEFmT+Wr0KgslXM/p2+9eR6a3qw8pt0vKHGLP9anW1F1p3PDDLcQ07fREbbpbddeFl0V7zJBSQO7xY5hqdXlZrNxB8WhGXYhVPr+o85viFehaqzzTBw=="}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:42.164728 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b9d68b8d-5ad9-4e1c-a98a-d9ee92fc0b06 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.674298 Jun 16 16:15:42.177071 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 236/473] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:41 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:42.197415 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-cffc6e2a-fae5-400e-87e1-19a45b94533b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Getting quotas for project c3592ee016d1486db983b4ff2aab5ca3. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:15:42.203638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-cffc6e2a-fae5-400e-87e1-19a45b94533b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Getting quotas for user 16b8389777744e6581ad14be85731f4a and project c3592ee016d1486db983b4ff2aab5ca3. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:15:42.239668 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cffc6e2a-fae5-400e-87e1-19a45b94533b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.096600 Jun 16 16:15:42.240300 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 238/474] 10.222.0.88 () {60 vars in 1158 bytes} [Thu Jun 16 16:15:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:43.162494 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ccdb0a56-0a76-4ce5-9e60-1a06e747a21e tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:43.164346 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ccdb0a56-0a76-4ce5-9e60-1a06e747a21e tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:43.174889 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ccdb0a56-0a76-4ce5-9e60-1a06e747a21e tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:43.177213 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ccdb0a56-0a76-4ce5-9e60-1a06e747a21e tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:43.178264 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ccdb0a56-0a76-4ce5-9e60-1a06e747a21e tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:43.179211 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ccdb0a56-0a76-4ce5-9e60-1a06e747a21e tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:43.182382 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-57bb9ba7-deb9-4b32-8549-485756048aa8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:43.182968 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-57bb9ba7-deb9-4b32-8549-485756048aa8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:43.191779 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-57bb9ba7-deb9-4b32-8549-485756048aa8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:43.197220 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-57bb9ba7-deb9-4b32-8549-485756048aa8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:43.198239 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-57bb9ba7-deb9-4b32-8549-485756048aa8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:43.198837 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-57bb9ba7-deb9-4b32-8549-485756048aa8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:43.563087 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-57bb9ba7-deb9-4b32-8549-485756048aa8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:43.563201 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ccdb0a56-0a76-4ce5-9e60-1a06e747a21e tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:43.573941 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-57bb9ba7-deb9-4b32-8549-485756048aa8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.395787 Jun 16 16:15:43.575740 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 239/475] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:43 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:43.592645 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ccdb0a56-0a76-4ce5-9e60-1a06e747a21e tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1470 microversion: 2.1 time: 0.437000 Jun 16 16:15:43.594544 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 237/476] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:43 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1470 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:44.264299 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d770f74b-11a0-4a3e-b908-56d3a2447f87 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2072985239", "imageRef": "d2716dc1-3d4d-4f62-b0af-c38986f2a3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "95eb63ba-1800-47ca-921c-a33b3a51a7cb"}], "security_groups": [{"name": "tempest-securitygroup--1139378944"}], "key_name": "tempest-keypair-748128690", "user_data": "}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:44.380715 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.network.neutron [None req-d770f74b-11a0-4a3e-b908-56d3a2447f87 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] validate_networks() for [('95eb63ba-1800-47ca-921c-a33b3a51a7cb', None, None, None, None, None)] {{(pid=117711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:15:44.593008 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c0c78d32-1070-4bb6-9cea-d1e62b7f0f39 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:44.594515 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c0c78d32-1070-4bb6-9cea-d1e62b7f0f39 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:44.602811 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c0c78d32-1070-4bb6-9cea-d1e62b7f0f39 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:44.603633 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c0c78d32-1070-4bb6-9cea-d1e62b7f0f39 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:44.606605 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c0c78d32-1070-4bb6-9cea-d1e62b7f0f39 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:44.607264 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c0c78d32-1070-4bb6-9cea-d1e62b7f0f39 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:44.956924 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c0c78d32-1070-4bb6-9cea-d1e62b7f0f39 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:44.973359 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c0c78d32-1070-4bb6-9cea-d1e62b7f0f39 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.384288 Jun 16 16:15:44.994262 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 238/477] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:44 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:45.011225 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-37054293-c575-45e4-a621-b2f57b5cd92f tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:45.013442 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-37054293-c575-45e4-a621-b2f57b5cd92f tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:45.023461 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-37054293-c575-45e4-a621-b2f57b5cd92f tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:45.024776 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-37054293-c575-45e4-a621-b2f57b5cd92f tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:45.026235 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-37054293-c575-45e4-a621-b2f57b5cd92f tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:45.027838 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-37054293-c575-45e4-a621-b2f57b5cd92f tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:45.168228 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-d770f74b-11a0-4a3e-b908-56d3a2447f87 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Flavor limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:15:45.169246 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-d770f74b-11a0-4a3e-b908-56d3a2447f87 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Image limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:15:45.170129 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-d770f74b-11a0-4a3e-b908-56d3a2447f87 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Flavor pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:15:45.175208 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-d770f74b-11a0-4a3e-b908-56d3a2447f87 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Image pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:15:45.176117 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-d770f74b-11a0-4a3e-b908-56d3a2447f87 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:15:45.203220 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d770f74b-11a0-4a3e-b908-56d3a2447f87 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:45.204308 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d770f74b-11a0-4a3e-b908-56d3a2447f87 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:45.205391 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d770f74b-11a0-4a3e-b908-56d3a2447f87 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:45.206055 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d770f74b-11a0-4a3e-b908-56d3a2447f87 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:45.248122 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-d770f74b-11a0-4a3e-b908-56d3a2447f87 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Getting quotas for project c3592ee016d1486db983b4ff2aab5ca3. Resources: {'ram', 'instances', 'cores'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:15:45.253547 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-d770f74b-11a0-4a3e-b908-56d3a2447f87 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Getting quotas for user 16b8389777744e6581ad14be85731f4a and project c3592ee016d1486db983b4ff2aab5ca3. Resources: {'ram', 'instances', 'cores'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:15:45.266955 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d770f74b-11a0-4a3e-b908-56d3a2447f87 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Going to run 1 instances... {{(pid=117711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:15:45.269516 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d770f74b-11a0-4a3e-b908-56d3a2447f87 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2716dc1-3d4d-4f62-b0af-c38986f2a3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:15:45.319776 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-37054293-c575-45e4-a621-b2f57b5cd92f tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:45.332808 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-37054293-c575-45e4-a621-b2f57b5cd92f tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1470 microversion: 2.1 time: 0.336147 Jun 16 16:15:45.336308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 239/478] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:44 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1470 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:45.354890 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d770f74b-11a0-4a3e-b908-56d3a2447f87 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.094765 Jun 16 16:15:45.355822 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 240/479] 10.222.0.88 () {60 vars in 1146 bytes} [Thu Jun 16 16:15:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 16:15:45.368238 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0ef18717-0fab-4c17-86fe-45a8554b5698 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:45.368870 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0ef18717-0fab-4c17-86fe-45a8554b5698 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:45.528190 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0ef18717-0fab-4c17-86fe-45a8554b5698 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:45.537119 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0ef18717-0fab-4c17-86fe-45a8554b5698 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1245 microversion: 2.1 time: 0.175329 Jun 16 16:15:45.537700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 240/480] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:45 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1245 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:45.992256 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0a942a60-a611-4abc-8770-a12c61450f2f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:45.993066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0a942a60-a611-4abc-8770-a12c61450f2f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:46.012076 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0a942a60-a611-4abc-8770-a12c61450f2f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:46.012517 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0a942a60-a611-4abc-8770-a12c61450f2f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:46.013308 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0a942a60-a611-4abc-8770-a12c61450f2f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:46.022972 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0a942a60-a611-4abc-8770-a12c61450f2f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:46.200285 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-5407d60e-a1a6-440b-aef8-87b93a9019e9 req-ea2655ca-911c-47d3-aa99-57fb2b622b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c", "name": "network-vif-deleted", "tag": "c757db64-168f-46a4-8d08-d52739845f89"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:46.222526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-5407d60e-a1a6-440b-aef8-87b93a9019e9 req-ea2655ca-911c-47d3-aa99-57fb2b622b45 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:46.229061 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-5407d60e-a1a6-440b-aef8-87b93a9019e9 req-ea2655ca-911c-47d3-aa99-57fb2b622b45 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:46.269733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-5407d60e-a1a6-440b-aef8-87b93a9019e9 req-ea2655ca-911c-47d3-aa99-57fb2b622b45 service nova] Creating event network-vif-deleted:c757db64-168f-46a4-8d08-d52739845f89 for instance f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c on hv-cinder-83735 Jun 16 16:15:46.283380 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-5407d60e-a1a6-440b-aef8-87b93a9019e9 req-ea2655ca-911c-47d3-aa99-57fb2b622b45 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093207 Jun 16 16:15:46.284643 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 241/481] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:15:46.351463 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cac76440-7abf-445c-ad2a-fa3b1aa55cc0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:46.352375 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-cac76440-7abf-445c-ad2a-fa3b1aa55cc0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:46.362266 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cac76440-7abf-445c-ad2a-fa3b1aa55cc0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:46.366344 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cac76440-7abf-445c-ad2a-fa3b1aa55cc0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:46.369538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cac76440-7abf-445c-ad2a-fa3b1aa55cc0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:46.372254 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cac76440-7abf-445c-ad2a-fa3b1aa55cc0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:46.440721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0a942a60-a611-4abc-8770-a12c61450f2f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:46.453489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cac76440-7abf-445c-ad2a-fa3b1aa55cc0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:46.457431 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cac76440-7abf-445c-ad2a-fa3b1aa55cc0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:46.458143 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-cac76440-7abf-445c-ad2a-fa3b1aa55cc0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lazy-loading 'fault' on Instance uuid f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:15:46.459650 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0a942a60-a611-4abc-8770-a12c61450f2f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.471494 Jun 16 16:15:46.461076 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 241/482] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:45 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:46.479928 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-73281de1-18b8-4440-81c4-3bf604c5ba48 req-7e207bab-6b30-44b2-9f80-9fa7439c920e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c92e5c48-0ac8-4a24-9e6b-019b7825b0b4", "name": "network-vif-plugged", "status": "completed", "tag": "fd0e55d6-c023-4540-8b9f-28e600c52b4f"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:46.490945 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-73281de1-18b8-4440-81c4-3bf604c5ba48 req-7e207bab-6b30-44b2-9f80-9fa7439c920e service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:46.492891 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-73281de1-18b8-4440-81c4-3bf604c5ba48 req-7e207bab-6b30-44b2-9f80-9fa7439c920e service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:46.515536 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-73281de1-18b8-4440-81c4-3bf604c5ba48 req-7e207bab-6b30-44b2-9f80-9fa7439c920e service nova] Creating event network-vif-plugged:fd0e55d6-c023-4540-8b9f-28e600c52b4f for instance c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 on hv-cinder-83735 Jun 16 16:15:46.530969 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-73281de1-18b8-4440-81c4-3bf604c5ba48 req-7e207bab-6b30-44b2-9f80-9fa7439c920e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053449 Jun 16 16:15:46.533430 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 242/483] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:46.543915 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cac76440-7abf-445c-ad2a-fa3b1aa55cc0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:46.552019 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-cac76440-7abf-445c-ad2a-fa3b1aa55cc0 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1304 microversion: 2.1 time: 0.205831 Jun 16 16:15:46.556900 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f74ac39a-36c5-483b-9f06-29c45aee05f5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:46.558752 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f74ac39a-36c5-483b-9f06-29c45aee05f5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:46.566056 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 242/484] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:46 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1304 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:46.571959 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f74ac39a-36c5-483b-9f06-29c45aee05f5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:46.572446 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f74ac39a-36c5-483b-9f06-29c45aee05f5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:46.573232 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f74ac39a-36c5-483b-9f06-29c45aee05f5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:46.573655 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f74ac39a-36c5-483b-9f06-29c45aee05f5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:46.662178 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f74ac39a-36c5-483b-9f06-29c45aee05f5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:46.671522 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f74ac39a-36c5-483b-9f06-29c45aee05f5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1297 microversion: 2.1 time: 0.120248 Jun 16 16:15:46.672093 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 243/485] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:46 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1297 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:47.476705 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-850d4ba9-4e2e-4159-aedb-9eba06560b96 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:47.477347 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-850d4ba9-4e2e-4159-aedb-9eba06560b96 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:47.484872 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-850d4ba9-4e2e-4159-aedb-9eba06560b96 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:47.485579 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-850d4ba9-4e2e-4159-aedb-9eba06560b96 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:47.486579 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-850d4ba9-4e2e-4159-aedb-9eba06560b96 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:47.487176 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-850d4ba9-4e2e-4159-aedb-9eba06560b96 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:47.510852 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=100 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:47.603104 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7e00e228-7675-4edc-8578-91d1585786b4 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:47.604854 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7e00e228-7675-4edc-8578-91d1585786b4 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:47.624422 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7e00e228-7675-4edc-8578-91d1585786b4 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:47.630739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7e00e228-7675-4edc-8578-91d1585786b4 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:47.631605 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7e00e228-7675-4edc-8578-91d1585786b4 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:47.637431 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7e00e228-7675-4edc-8578-91d1585786b4 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:47.698026 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7e00e228-7675-4edc-8578-91d1585786b4 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:47.698026 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7e00e228-7675-4edc-8578-91d1585786b4 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:47.698557 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-7e00e228-7675-4edc-8578-91d1585786b4 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lazy-loading 'fault' on Instance uuid f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:15:47.746191 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-850d4ba9-4e2e-4159-aedb-9eba06560b96 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:47.759634 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-850d4ba9-4e2e-4159-aedb-9eba06560b96 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.286925 Jun 16 16:15:47.763359 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7e00e228-7675-4edc-8578-91d1585786b4 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0dcd599835413a9271a038bec143a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999705a6bba24e4198240e1f8b08c4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:47.780788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7e00e228-7675-4edc-8578-91d1585786b4 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 200 len: 1304 microversion: 2.1 time: 0.200466 Jun 16 16:15:47.781190 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 243/486] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:47 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:47.786808 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 244/487] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:47 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 1304 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:47.787364 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-18be61c5-8e9b-46e7-ab06-11f7faa1b191 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:47.788778 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-18be61c5-8e9b-46e7-ab06-11f7faa1b191 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:47.796072 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-18be61c5-8e9b-46e7-ab06-11f7faa1b191 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:47.796894 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-18be61c5-8e9b-46e7-ab06-11f7faa1b191 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:47.797652 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-18be61c5-8e9b-46e7-ab06-11f7faa1b191 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:47.798382 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-18be61c5-8e9b-46e7-ab06-11f7faa1b191 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:47.882914 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-18be61c5-8e9b-46e7-ab06-11f7faa1b191 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:47.899299 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-18be61c5-8e9b-46e7-ab06-11f7faa1b191 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1297 microversion: 2.1 time: 0.108890 Jun 16 16:15:47.899299 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 244/488] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:47 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1297 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:48.784463 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cf359a95-fa06-4eac-9c67-158d359da2f2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:48.785739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-cf359a95-fa06-4eac-9c67-158d359da2f2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:48.812015 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2f7824df-fe2b-4e83-b5ce-243ceaf1ceb2 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:48.823670 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2f7824df-fe2b-4e83-b5ce-243ceaf1ceb2 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] [instance: f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:48.826458 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cf359a95-fa06-4eac-9c67-158d359da2f2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:48.829512 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cf359a95-fa06-4eac-9c67-158d359da2f2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:48.830654 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cf359a95-fa06-4eac-9c67-158d359da2f2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:48.834218 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cf359a95-fa06-4eac-9c67-158d359da2f2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:48.839220 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2f7824df-fe2b-4e83-b5ce-243ceaf1ceb2 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:48.839895 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2f7824df-fe2b-4e83-b5ce-243ceaf1ceb2 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:48.840959 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2f7824df-fe2b-4e83-b5ce-243ceaf1ceb2 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:48.841857 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2f7824df-fe2b-4e83-b5ce-243ceaf1ceb2 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:48.875167 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-2f7824df-fe2b-4e83-b5ce-243ceaf1ceb2 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] HTTP exception thrown: Instance f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c could not be found. Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2f7824df-fe2b-4e83-b5ce-243ceaf1ceb2 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Request method failure captured: Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c HTTP/1.1 Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1b3YDXCHg6sa6HxS-XtYFwLsWNFe-9Dj88bOrnzOpdoQkFkvAUGPD7SVNR56qx_TC3jh2AHfHtiLqXnMzieSYyESGEqHyLf07g7UvwaS7oQveuKiqxqc8iFmq3AfoaiuAeej7KQk9Sbh_i-NCjg-QeWZpeCEdI_QWV10w-7CY0TeFQ Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: 999705a6bba24e4198240e1f8b08c4d9 Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesNegativeTest-153224057 Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:15:48.877355 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:15:48.879101 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/999705a6bba24e4198240e1f8b08c4d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/999705a6bba24e4198240e1f8b08c4d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_999705a6bba24e4198240e1f8b08c4d9", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/999705a6bba24e4198240e1f8b08c4d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:15:48.879101 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesNegativeTest-153224057 Jun 16 16:15:48.879101 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 999705a6bba24e4198240e1f8b08c4d9 Jun 16 16:15:48.879101 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesNegativeTest-153224057 Jun 16 16:15:48.879101 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesNegativeTest-153224057-project Jun 16 16:15:48.879101 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:15:48.879101 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:15:48.879101 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: 6e0dcd599835413a9271a038bec143a1 Jun 16 16:15:48.879101 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesNegativeTest-153224057-project Jun 16 16:15:48.879101 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:15:48.879101 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Instance f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c could not be found. Jun 16 16:15:48.879101 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': 'f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c'} Jun 16 16:15:48.880084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:15:48.880084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:48.880084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:15:48.880084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:15:48.880084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:15:48.880084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:15:48.880084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:15:48.880084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:15:48.880084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:15:48.880084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:15:48.880084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c could not be found. Jun 16 16:15:48.880084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:48.880084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:48.880084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:48.880084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:48.880084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:48.880084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:48.880084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:15:48.880084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:15:48.880084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:15:48.881641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:15:48.881641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:15:48.881641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:15:48.881641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:15:48.881641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:15:48.881641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:15:48.881641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:15:48.881641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c could not be found. Jun 16 16:15:48.881641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:48.881641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:15:48.881641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:48.881641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:15:48.881641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:15:48.881641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:15:48.881641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:15:48.881641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:15:48.881641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c could not be found. Jun 16 16:15:48.881641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:15:48.888366 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2f7824df-fe2b-4e83-b5ce-243ceaf1ceb2 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] Returning 404 to user: Instance f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:15:48.889830 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2f7824df-fe2b-4e83-b5ce-243ceaf1ceb2 tempest-VolumesNegativeTest-153224057 tempest-VolumesNegativeTest-153224057-project] 10.222.0.88 "GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c" status: 404 len: 111 microversion: 2.1 time: 0.090083 Jun 16 16:15:48.894907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 245/489] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:48 2022] GET /compute/v2.1/servers/f7119b80-5dc7-41f8-ad24-4a9dd7f7f21c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:15:48.915399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4b980b52-a6e2-4cb9-a6a4-48f095ba6b25 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:48.916282 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4b980b52-a6e2-4cb9-a6a4-48f095ba6b25 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:48.925840 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4b980b52-a6e2-4cb9-a6a4-48f095ba6b25 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:48.929047 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4b980b52-a6e2-4cb9-a6a4-48f095ba6b25 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:48.930648 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4b980b52-a6e2-4cb9-a6a4-48f095ba6b25 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:48.934658 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4b980b52-a6e2-4cb9-a6a4-48f095ba6b25 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:49.068760 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4b980b52-a6e2-4cb9-a6a4-48f095ba6b25 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:49.084350 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4b980b52-a6e2-4cb9-a6a4-48f095ba6b25 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1297 microversion: 2.1 time: 0.173719 Jun 16 16:15:49.085098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 246/490] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:48 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1297 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:49.135311 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cf359a95-fa06-4eac-9c67-158d359da2f2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:49.157264 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cf359a95-fa06-4eac-9c67-158d359da2f2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.376526 Jun 16 16:15:49.166682 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 245/491] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:48 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:50.101431 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7ce6f188-73f6-4eec-8c6c-7579752bbd4a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:50.102084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7ce6f188-73f6-4eec-8c6c-7579752bbd4a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:50.110111 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7ce6f188-73f6-4eec-8c6c-7579752bbd4a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:50.111136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7ce6f188-73f6-4eec-8c6c-7579752bbd4a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:50.112073 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7ce6f188-73f6-4eec-8c6c-7579752bbd4a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:50.112737 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7ce6f188-73f6-4eec-8c6c-7579752bbd4a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:50.174731 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d75a503c-a9a4-4515-b859-c47208874af2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:50.175434 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d75a503c-a9a4-4515-b859-c47208874af2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:50.188245 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d75a503c-a9a4-4515-b859-c47208874af2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:50.188699 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d75a503c-a9a4-4515-b859-c47208874af2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:50.189475 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d75a503c-a9a4-4515-b859-c47208874af2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:50.189980 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d75a503c-a9a4-4515-b859-c47208874af2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:50.211254 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7ce6f188-73f6-4eec-8c6c-7579752bbd4a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:50.220123 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7ce6f188-73f6-4eec-8c6c-7579752bbd4a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1297 microversion: 2.1 time: 0.123006 Jun 16 16:15:50.221174 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 247/492] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:50 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1297 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:50.404739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d75a503c-a9a4-4515-b859-c47208874af2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:50.415021 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d75a503c-a9a4-4515-b859-c47208874af2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.244415 Jun 16 16:15:50.418190 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 246/493] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:50 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:51.239255 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b7040e0b-d360-4c66-b285-9ae8f65f3153 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:51.240506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b7040e0b-d360-4c66-b285-9ae8f65f3153 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:51.249182 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b7040e0b-d360-4c66-b285-9ae8f65f3153 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:51.249829 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b7040e0b-d360-4c66-b285-9ae8f65f3153 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:51.250634 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b7040e0b-d360-4c66-b285-9ae8f65f3153 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:51.251151 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b7040e0b-d360-4c66-b285-9ae8f65f3153 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:51.328618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b7040e0b-d360-4c66-b285-9ae8f65f3153 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:51.337227 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b7040e0b-d360-4c66-b285-9ae8f65f3153 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1305 microversion: 2.1 time: 0.102580 Jun 16 16:15:51.347688 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 248/494] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:51 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:51.432345 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-70d10c6b-b1e1-435c-839b-7d327f89a350 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:51.433573 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-70d10c6b-b1e1-435c-839b-7d327f89a350 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:51.441863 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-70d10c6b-b1e1-435c-839b-7d327f89a350 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:51.442663 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-70d10c6b-b1e1-435c-839b-7d327f89a350 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:51.443762 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-70d10c6b-b1e1-435c-839b-7d327f89a350 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:51.445377 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-70d10c6b-b1e1-435c-839b-7d327f89a350 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:51.885687 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-70d10c6b-b1e1-435c-839b-7d327f89a350 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:51.894030 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-70d10c6b-b1e1-435c-839b-7d327f89a350 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.465984 Jun 16 16:15:51.894943 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 247/495] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:51 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:52.364921 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-90b7ca79-c26c-4f70-bee0-d7102f0b86cc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:52.364921 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-90b7ca79-c26c-4f70-bee0-d7102f0b86cc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:52.374133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-90b7ca79-c26c-4f70-bee0-d7102f0b86cc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:52.374599 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-90b7ca79-c26c-4f70-bee0-d7102f0b86cc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:52.376659 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-90b7ca79-c26c-4f70-bee0-d7102f0b86cc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:52.376659 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-90b7ca79-c26c-4f70-bee0-d7102f0b86cc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:52.490362 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-90b7ca79-c26c-4f70-bee0-d7102f0b86cc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:52.508394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-90b7ca79-c26c-4f70-bee0-d7102f0b86cc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1303 microversion: 2.1 time: 0.157274 Jun 16 16:15:52.519973 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 249/496] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:52 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1303 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:52.911399 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6e87620f-67c7-4033-83f5-fb832b34d0d3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:52.912737 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6e87620f-67c7-4033-83f5-fb832b34d0d3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:52.919942 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6e87620f-67c7-4033-83f5-fb832b34d0d3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:52.920712 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6e87620f-67c7-4033-83f5-fb832b34d0d3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:52.921556 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6e87620f-67c7-4033-83f5-fb832b34d0d3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:52.922079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6e87620f-67c7-4033-83f5-fb832b34d0d3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:52.941918 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:53.078289 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6e87620f-67c7-4033-83f5-fb832b34d0d3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:53.087800 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6e87620f-67c7-4033-83f5-fb832b34d0d3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.180344 Jun 16 16:15:53.088612 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 248/497] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:52 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:53.524461 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7a781a30-6e8b-48ac-9b0d-d1946768d45a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:53.525862 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7a781a30-6e8b-48ac-9b0d-d1946768d45a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:53.536643 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7a781a30-6e8b-48ac-9b0d-d1946768d45a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:53.537443 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7a781a30-6e8b-48ac-9b0d-d1946768d45a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:53.538999 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7a781a30-6e8b-48ac-9b0d-d1946768d45a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:53.539641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7a781a30-6e8b-48ac-9b0d-d1946768d45a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:53.635436 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7a781a30-6e8b-48ac-9b0d-d1946768d45a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:53.644660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7a781a30-6e8b-48ac-9b0d-d1946768d45a tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1303 microversion: 2.1 time: 0.123964 Jun 16 16:15:53.656948 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 250/498] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:53 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1303 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:54.105824 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cf2cf545-ddbb-41d4-a830-e8330e1ae661 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:54.106926 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-cf2cf545-ddbb-41d4-a830-e8330e1ae661 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:54.117334 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cf2cf545-ddbb-41d4-a830-e8330e1ae661 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:54.118130 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cf2cf545-ddbb-41d4-a830-e8330e1ae661 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:54.119058 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cf2cf545-ddbb-41d4-a830-e8330e1ae661 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:54.119928 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cf2cf545-ddbb-41d4-a830-e8330e1ae661 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:54.286867 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cf2cf545-ddbb-41d4-a830-e8330e1ae661 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:54.294809 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cf2cf545-ddbb-41d4-a830-e8330e1ae661 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.193873 Jun 16 16:15:54.299648 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 249/499] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:54 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:54.663720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1f0fe0a2-beaf-4090-b24f-53e8ab7b9f49 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:54.664950 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1f0fe0a2-beaf-4090-b24f-53e8ab7b9f49 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:54.671830 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1f0fe0a2-beaf-4090-b24f-53e8ab7b9f49 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:54.672709 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1f0fe0a2-beaf-4090-b24f-53e8ab7b9f49 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:54.673489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1f0fe0a2-beaf-4090-b24f-53e8ab7b9f49 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:54.674216 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1f0fe0a2-beaf-4090-b24f-53e8ab7b9f49 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:54.837495 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1f0fe0a2-beaf-4090-b24f-53e8ab7b9f49 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:54.845060 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1f0fe0a2-beaf-4090-b24f-53e8ab7b9f49 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.187124 Jun 16 16:15:54.845788 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 251/500] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:54 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:55.310785 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:55.312237 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=10 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:55.318124 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-09872611-70a2-45da-b883-2e60763363c2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:55.323354 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-09872611-70a2-45da-b883-2e60763363c2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:55.326865 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-09872611-70a2-45da-b883-2e60763363c2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:55.327418 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-09872611-70a2-45da-b883-2e60763363c2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:55.328811 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-09872611-70a2-45da-b883-2e60763363c2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:55.329416 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-09872611-70a2-45da-b883-2e60763363c2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:55.479973 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-09872611-70a2-45da-b883-2e60763363c2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:55.487506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-09872611-70a2-45da-b883-2e60763363c2 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.177989 Jun 16 16:15:55.488326 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 250/501] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:55 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:55.862318 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-85123825-ff7c-45ab-8f7d-c1b10691e902 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:55.864226 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-85123825-ff7c-45ab-8f7d-c1b10691e902 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:55.866512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:55.872104 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-85123825-ff7c-45ab-8f7d-c1b10691e902 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:55.872550 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-85123825-ff7c-45ab-8f7d-c1b10691e902 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:55.873329 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-85123825-ff7c-45ab-8f7d-c1b10691e902 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:55.873780 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-85123825-ff7c-45ab-8f7d-c1b10691e902 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:55.942437 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5d92ecca-a48c-415a-982e-326809316956 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Action: 'create', calling method: .version_select at 0x7f6f0d41a9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-111651302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmT/jDpZ6fNLbtswiMSk6nWPjuEIYjEYxjjYPIog2uD4/nEHC37kV4plfcmjO7WblEWDmoVELpEFHi5E/5oRLakt5/1WoB/y23t2PuBdocXBSi1zzhVQ/Ck0MRnXevLRA=="}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:55.956724 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-5d92ecca-a48c-415a-982e-326809316956 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Getting quotas for project 731df982fd964de6bc4545103f7e1047. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:15:55.960580 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-5d92ecca-a48c-415a-982e-326809316956 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Getting quotas for user 6e097835e6604a02a38b291786033f06 and project 731df982fd964de6bc4545103f7e1047. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:15:55.986554 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5d92ecca-a48c-415a-982e-326809316956 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.047954 Jun 16 16:15:55.987158 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 251/502] 10.222.0.88 () {60 vars in 1158 bytes} [Thu Jun 16 16:15:55 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:15:56.027294 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-85123825-ff7c-45ab-8f7d-c1b10691e902 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:56.035077 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-85123825-ff7c-45ab-8f7d-c1b10691e902 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.176572 Jun 16 16:15:56.035869 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 252/503] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:55 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:56.039981 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-90f83684-f548-4b19-950c-9eb535bb7eca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1652819628", "imageRef": "378b3e7f-b8bc-474c-a910-7e8e7ac448c6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-111651302", "networks": [{"uuid": "624ec5cb-c351-4f2a-b62b-b23581055ec7"}]}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:56.090991 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.network.neutron [None req-90f83684-f548-4b19-950c-9eb535bb7eca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] validate_networks() for [('624ec5cb-c351-4f2a-b62b-b23581055ec7', None, None, None, None, None)] {{(pid=117711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:15:56.455254 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-90f83684-f548-4b19-950c-9eb535bb7eca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Flavor limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:15:56.455858 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-90f83684-f548-4b19-950c-9eb535bb7eca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Image limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:15:56.456148 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-90f83684-f548-4b19-950c-9eb535bb7eca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Flavor pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:15:56.456547 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-90f83684-f548-4b19-950c-9eb535bb7eca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Image pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:15:56.456949 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-90f83684-f548-4b19-950c-9eb535bb7eca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:15:56.465605 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-90f83684-f548-4b19-950c-9eb535bb7eca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:56.466067 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-90f83684-f548-4b19-950c-9eb535bb7eca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:56.466849 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-90f83684-f548-4b19-950c-9eb535bb7eca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:56.467401 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-90f83684-f548-4b19-950c-9eb535bb7eca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:56.484847 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-90f83684-f548-4b19-950c-9eb535bb7eca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Getting quotas for project 731df982fd964de6bc4545103f7e1047. Resources: {'ram', 'instances', 'cores'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:15:56.488755 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-90f83684-f548-4b19-950c-9eb535bb7eca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Getting quotas for user 6e097835e6604a02a38b291786033f06 and project 731df982fd964de6bc4545103f7e1047. Resources: {'ram', 'instances', 'cores'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:15:56.500694 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-90f83684-f548-4b19-950c-9eb535bb7eca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Going to run 1 instances... {{(pid=117711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:15:56.502949 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-90f83684-f548-4b19-950c-9eb535bb7eca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='378b3e7f-b8bc-474c-a910-7e8e7ac448c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:15:56.504551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-aa9ebcff-3edd-4b4c-98bf-88f8fcabcdc8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:56.505249 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-aa9ebcff-3edd-4b4c-98bf-88f8fcabcdc8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:56.511859 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa9ebcff-3edd-4b4c-98bf-88f8fcabcdc8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:56.512430 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa9ebcff-3edd-4b4c-98bf-88f8fcabcdc8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:56.513206 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa9ebcff-3edd-4b4c-98bf-88f8fcabcdc8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:56.513706 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa9ebcff-3edd-4b4c-98bf-88f8fcabcdc8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:56.550522 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-90f83684-f548-4b19-950c-9eb535bb7eca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514757 Jun 16 16:15:56.551175 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 252/504] 10.222.0.88 () {60 vars in 1146 bytes} [Thu Jun 16 16:15:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 16:15:56.561695 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-283d0f22-57d5-48b4-9378-606241695595 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:56.562253 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-283d0f22-57d5-48b4-9378-606241695595 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:56.571069 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=8 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:56.630234 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-283d0f22-57d5-48b4-9378-606241695595 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:56.639065 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-283d0f22-57d5-48b4-9378-606241695595 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1258 microversion: 2.1 time: 0.081206 Jun 16 16:15:56.639886 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 253/505] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:56 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1258 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:56.678711 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-aa9ebcff-3edd-4b4c-98bf-88f8fcabcdc8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:56.686322 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-aa9ebcff-3edd-4b4c-98bf-88f8fcabcdc8 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.185884 Jun 16 16:15:56.686887 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 253/506] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:56 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:57.052578 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8240bd4b-ee70-4980-a441-fef4852a1bbc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:57.053115 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8240bd4b-ee70-4980-a441-fef4852a1bbc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:57.059845 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8240bd4b-ee70-4980-a441-fef4852a1bbc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:57.060293 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8240bd4b-ee70-4980-a441-fef4852a1bbc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:57.061051 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8240bd4b-ee70-4980-a441-fef4852a1bbc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:57.061490 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8240bd4b-ee70-4980-a441-fef4852a1bbc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:57.196066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8240bd4b-ee70-4980-a441-fef4852a1bbc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:57.203392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8240bd4b-ee70-4980-a441-fef4852a1bbc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.154844 Jun 16 16:15:57.203953 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 254/507] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:57 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:57.658970 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cfd075be-6664-4d32-824d-d6926cc5ec5a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:57.660394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-cfd075be-6664-4d32-824d-d6926cc5ec5a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:57.668082 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cfd075be-6664-4d32-824d-d6926cc5ec5a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:57.668663 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cfd075be-6664-4d32-824d-d6926cc5ec5a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:57.669667 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cfd075be-6664-4d32-824d-d6926cc5ec5a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:57.675803 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cfd075be-6664-4d32-824d-d6926cc5ec5a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:57.703640 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3b1e1e4a-b5bb-4a22-b218-15273578075b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:57.704903 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3b1e1e4a-b5bb-4a22-b218-15273578075b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:57.712573 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3b1e1e4a-b5bb-4a22-b218-15273578075b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:57.713028 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3b1e1e4a-b5bb-4a22-b218-15273578075b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:57.713837 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3b1e1e4a-b5bb-4a22-b218-15273578075b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:57.714278 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3b1e1e4a-b5bb-4a22-b218-15273578075b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:57.770402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cfd075be-6664-4d32-824d-d6926cc5ec5a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:57.778666 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-cfd075be-6664-4d32-824d-d6926cc5ec5a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1310 microversion: 2.1 time: 0.125598 Jun 16 16:15:57.779570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 254/508] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:57 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1310 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:57.940136 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3b1e1e4a-b5bb-4a22-b218-15273578075b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:57.948979 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3b1e1e4a-b5bb-4a22-b218-15273578075b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1259 microversion: 2.1 time: 0.249245 Jun 16 16:15:57.949562 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 255/509] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:57 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1259 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:58.220754 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-25efb2cf-725f-4f6a-bccd-1160a6b7fe62 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:58.221749 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-25efb2cf-725f-4f6a-bccd-1160a6b7fe62 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:58.223687 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-9d27150d-ff59-4df2-8df6-29df3973fec0 req-f56f6d09-7ceb-4393-b5ec-6e2a12726e68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bac54eb-7ea8-4c97-a1f1-7c1da22baccd", "tag": "620a39ba-f7e2-4ae1-acf0-e87136dc559c"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:15:58.228785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-25efb2cf-725f-4f6a-bccd-1160a6b7fe62 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:58.229509 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-25efb2cf-725f-4f6a-bccd-1160a6b7fe62 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:58.230556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-25efb2cf-725f-4f6a-bccd-1160a6b7fe62 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:58.231204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-25efb2cf-725f-4f6a-bccd-1160a6b7fe62 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:58.234817 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-9d27150d-ff59-4df2-8df6-29df3973fec0 req-f56f6d09-7ceb-4393-b5ec-6e2a12726e68 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:58.235865 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-9d27150d-ff59-4df2-8df6-29df3973fec0 req-f56f6d09-7ceb-4393-b5ec-6e2a12726e68 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:58.249641 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-9d27150d-ff59-4df2-8df6-29df3973fec0 req-f56f6d09-7ceb-4393-b5ec-6e2a12726e68 service nova] Creating event network-changed:620a39ba-f7e2-4ae1-acf0-e87136dc559c for instance 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd on hv-cinder-83735 Jun 16 16:15:58.255928 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-9d27150d-ff59-4df2-8df6-29df3973fec0 req-f56f6d09-7ceb-4393-b5ec-6e2a12726e68 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036528 Jun 16 16:15:58.257037 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 256/510] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:15:58.379392 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-25efb2cf-725f-4f6a-bccd-1160a6b7fe62 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:58.389013 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-25efb2cf-725f-4f6a-bccd-1160a6b7fe62 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.171994 Jun 16 16:15:58.389676 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 255/511] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:58 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:58.797581 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7ef3b71a-256f-4466-a340-53ca0364c3e2 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:58.798594 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7ef3b71a-256f-4466-a340-53ca0364c3e2 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:58.805537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ef3b71a-256f-4466-a340-53ca0364c3e2 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:58.806163 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ef3b71a-256f-4466-a340-53ca0364c3e2 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:58.807165 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ef3b71a-256f-4466-a340-53ca0364c3e2 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:58.807599 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7ef3b71a-256f-4466-a340-53ca0364c3e2 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:58.882992 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7ef3b71a-256f-4466-a340-53ca0364c3e2 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:58.890460 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7ef3b71a-256f-4466-a340-53ca0364c3e2 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1318 microversion: 2.1 time: 0.097850 Jun 16 16:15:58.891038 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 257/512] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:58 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1318 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:58.967815 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9c2c820f-7ee2-4f31-adc1-dcd3c93ee39f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:58.968433 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9c2c820f-7ee2-4f31-adc1-dcd3c93ee39f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:58.974919 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c2c820f-7ee2-4f31-adc1-dcd3c93ee39f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:58.977202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c2c820f-7ee2-4f31-adc1-dcd3c93ee39f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:58.977202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c2c820f-7ee2-4f31-adc1-dcd3c93ee39f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:58.977202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c2c820f-7ee2-4f31-adc1-dcd3c93ee39f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:59.153812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9c2c820f-7ee2-4f31-adc1-dcd3c93ee39f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:59.161403 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9c2c820f-7ee2-4f31-adc1-dcd3c93ee39f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1442 microversion: 2.1 time: 0.197448 Jun 16 16:15:59.162010 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 256/513] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:58 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1442 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:59.178792 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-02c0da4e-b501-481e-b07c-204d3f8e24f9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:59.179677 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-02c0da4e-b501-481e-b07c-204d3f8e24f9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:59.186002 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-02c0da4e-b501-481e-b07c-204d3f8e24f9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:59.186484 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-02c0da4e-b501-481e-b07c-204d3f8e24f9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:59.187501 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-02c0da4e-b501-481e-b07c-204d3f8e24f9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:59.187994 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-02c0da4e-b501-481e-b07c-204d3f8e24f9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:59.343337 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-02c0da4e-b501-481e-b07c-204d3f8e24f9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:59.353029 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-02c0da4e-b501-481e-b07c-204d3f8e24f9 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1442 microversion: 2.1 time: 0.178585 Jun 16 16:15:59.359226 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 258/514] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:59 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1442 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:15:59.406752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ff2161a1-cfa0-4bff-a008-53c075ddec64 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:59.407903 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ff2161a1-cfa0-4bff-a008-53c075ddec64 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:59.415011 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ff2161a1-cfa0-4bff-a008-53c075ddec64 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:59.415459 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ff2161a1-cfa0-4bff-a008-53c075ddec64 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:59.416435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ff2161a1-cfa0-4bff-a008-53c075ddec64 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:59.416865 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ff2161a1-cfa0-4bff-a008-53c075ddec64 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:59.618021 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ff2161a1-cfa0-4bff-a008-53c075ddec64 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:15:59.628467 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ff2161a1-cfa0-4bff-a008-53c075ddec64 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.225414 Jun 16 16:15:59.629509 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 257/515] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:59 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:15:59.908495 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-15cc470c-de18-497c-a6f1-9595361f02ca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:15:59.909300 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-15cc470c-de18-497c-a6f1-9595361f02ca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:15:59.917579 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-15cc470c-de18-497c-a6f1-9595361f02ca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:59.918201 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-15cc470c-de18-497c-a6f1-9595361f02ca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:59.919216 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-15cc470c-de18-497c-a6f1-9595361f02ca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:15:59.919760 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-15cc470c-de18-497c-a6f1-9595361f02ca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:15:59.995919 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-15cc470c-de18-497c-a6f1-9595361f02ca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:00.003375 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-15cc470c-de18-497c-a6f1-9595361f02ca tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1328 microversion: 2.1 time: 0.099087 Jun 16 16:16:00.003949 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 259/516] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:15:59 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:00.646335 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-13da1e73-c801-4d9e-b35b-0628f0cf431e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:00.647652 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-13da1e73-c801-4d9e-b35b-0628f0cf431e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:00.654511 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-13da1e73-c801-4d9e-b35b-0628f0cf431e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:00.654959 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-13da1e73-c801-4d9e-b35b-0628f0cf431e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:00.655730 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-13da1e73-c801-4d9e-b35b-0628f0cf431e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:00.656169 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-13da1e73-c801-4d9e-b35b-0628f0cf431e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:01.020995 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a2a256eb-bbfd-46c0-a410-e8b2c931eff8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:01.021619 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a2a256eb-bbfd-46c0-a410-e8b2c931eff8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:01.028208 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a2a256eb-bbfd-46c0-a410-e8b2c931eff8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:01.028663 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a2a256eb-bbfd-46c0-a410-e8b2c931eff8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:01.029427 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a2a256eb-bbfd-46c0-a410-e8b2c931eff8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:01.029898 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a2a256eb-bbfd-46c0-a410-e8b2c931eff8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:01.038202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-13da1e73-c801-4d9e-b35b-0628f0cf431e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:01.046192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-13da1e73-c801-4d9e-b35b-0628f0cf431e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.403584 Jun 16 16:16:01.046774 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 258/517] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:00 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:01.105095 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a2a256eb-bbfd-46c0-a410-e8b2c931eff8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:01.112526 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a2a256eb-bbfd-46c0-a410-e8b2c931eff8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1316 microversion: 2.1 time: 0.095433 Jun 16 16:16:01.113092 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 260/518] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:01 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1316 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:01.826898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-935cbeea-9958-49e0-adfb-41acfbe95f14 req-14c78cfc-cc12-42fa-8268-56f30b7fbe91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c92e5c48-0ac8-4a24-9e6b-019b7825b0b4", "tag": "fd0e55d6-c023-4540-8b9f-28e600c52b4f"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:01.835696 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-935cbeea-9958-49e0-adfb-41acfbe95f14 req-14c78cfc-cc12-42fa-8268-56f30b7fbe91 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:01.836142 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-935cbeea-9958-49e0-adfb-41acfbe95f14 req-14c78cfc-cc12-42fa-8268-56f30b7fbe91 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:01.847079 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-935cbeea-9958-49e0-adfb-41acfbe95f14 req-14c78cfc-cc12-42fa-8268-56f30b7fbe91 service nova] Creating event network-changed:fd0e55d6-c023-4540-8b9f-28e600c52b4f for instance c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 on hv-cinder-83735 Jun 16 16:16:01.853117 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-935cbeea-9958-49e0-adfb-41acfbe95f14 req-14c78cfc-cc12-42fa-8268-56f30b7fbe91 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029979 Jun 16 16:16:01.853712 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 259/519] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:02.064385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-64ca21de-e5de-4e41-a39d-15b6f49c6c3f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:02.065277 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-64ca21de-e5de-4e41-a39d-15b6f49c6c3f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:02.072406 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-64ca21de-e5de-4e41-a39d-15b6f49c6c3f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:02.072855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-64ca21de-e5de-4e41-a39d-15b6f49c6c3f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:02.073633 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-64ca21de-e5de-4e41-a39d-15b6f49c6c3f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:02.074103 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-64ca21de-e5de-4e41-a39d-15b6f49c6c3f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:02.133773 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-33a74166-d462-4639-ad9a-3608d3e69151 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:02.133773 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-33a74166-d462-4639-ad9a-3608d3e69151 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:02.140137 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-33a74166-d462-4639-ad9a-3608d3e69151 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:02.140586 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-33a74166-d462-4639-ad9a-3608d3e69151 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:02.141337 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-33a74166-d462-4639-ad9a-3608d3e69151 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:02.142129 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-33a74166-d462-4639-ad9a-3608d3e69151 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:02.231788 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-33a74166-d462-4639-ad9a-3608d3e69151 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:02.242596 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-33a74166-d462-4639-ad9a-3608d3e69151 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1316 microversion: 2.1 time: 0.115669 Jun 16 16:16:02.243282 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 260/520] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:02 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1316 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:02.256985 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-64ca21de-e5de-4e41-a39d-15b6f49c6c3f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:02.264542 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-64ca21de-e5de-4e41-a39d-15b6f49c6c3f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.204162 Jun 16 16:16:02.265113 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 261/521] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:02 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:03.259949 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f9a736f3-7762-4258-be47-582158d06c18 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:03.260567 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f9a736f3-7762-4258-be47-582158d06c18 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:03.267113 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f9a736f3-7762-4258-be47-582158d06c18 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:03.267628 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f9a736f3-7762-4258-be47-582158d06c18 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:03.268427 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f9a736f3-7762-4258-be47-582158d06c18 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:03.268863 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f9a736f3-7762-4258-be47-582158d06c18 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:03.283543 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e02ddc5a-1079-4bc4-90fe-fee0e8474327 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:03.284775 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e02ddc5a-1079-4bc4-90fe-fee0e8474327 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:03.295022 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e02ddc5a-1079-4bc4-90fe-fee0e8474327 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:03.295747 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e02ddc5a-1079-4bc4-90fe-fee0e8474327 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:03.297006 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e02ddc5a-1079-4bc4-90fe-fee0e8474327 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:03.297754 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e02ddc5a-1079-4bc4-90fe-fee0e8474327 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:03.300228 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=100 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:03.356221 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f9a736f3-7762-4258-be47-582158d06c18 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:03.364033 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f9a736f3-7762-4258-be47-582158d06c18 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1316 microversion: 2.1 time: 0.108354 Jun 16 16:16:03.364612 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 261/522] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:03 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1316 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:03.447591 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e02ddc5a-1079-4bc4-90fe-fee0e8474327 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:03.455187 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e02ddc5a-1079-4bc4-90fe-fee0e8474327 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.178327 Jun 16 16:16:03.455716 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 262/523] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:03 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:04.385283 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3032ee2a-af79-4314-9ef4-8629ac8f863f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:04.386823 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3032ee2a-af79-4314-9ef4-8629ac8f863f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:04.398614 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3032ee2a-af79-4314-9ef4-8629ac8f863f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:04.399518 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3032ee2a-af79-4314-9ef4-8629ac8f863f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:04.400575 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3032ee2a-af79-4314-9ef4-8629ac8f863f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:04.402373 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3032ee2a-af79-4314-9ef4-8629ac8f863f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:04.473427 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0a214edb-76c0-4a95-a0a2-00ee62c95208 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:04.475008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0a214edb-76c0-4a95-a0a2-00ee62c95208 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:04.485634 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0a214edb-76c0-4a95-a0a2-00ee62c95208 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:04.487852 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0a214edb-76c0-4a95-a0a2-00ee62c95208 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:04.491499 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0a214edb-76c0-4a95-a0a2-00ee62c95208 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:04.495313 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0a214edb-76c0-4a95-a0a2-00ee62c95208 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:04.933628 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3032ee2a-af79-4314-9ef4-8629ac8f863f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:04.941119 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3032ee2a-af79-4314-9ef4-8629ac8f863f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1316 microversion: 2.1 time: 0.564100 Jun 16 16:16:04.941691 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 262/524] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:04 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1316 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:05.089651 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0a214edb-76c0-4a95-a0a2-00ee62c95208 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:05.101365 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0a214edb-76c0-4a95-a0a2-00ee62c95208 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.632200 Jun 16 16:16:05.102262 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 263/525] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:04 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:05.957608 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-52785624-2115-41dc-bea9-1b5b4ff74859 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:05.958332 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-52785624-2115-41dc-bea9-1b5b4ff74859 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:05.965570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-52785624-2115-41dc-bea9-1b5b4ff74859 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:05.966050 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-52785624-2115-41dc-bea9-1b5b4ff74859 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:05.966838 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-52785624-2115-41dc-bea9-1b5b4ff74859 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:05.967301 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-52785624-2115-41dc-bea9-1b5b4ff74859 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:06.049375 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:16:06.051136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Thu Jun 16 16:16:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d (ip 10.222.0.88) !!! Jun 16 16:16:06.104799 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-52785624-2115-41dc-bea9-1b5b4ff74859 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:06.116212 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-52785624-2115-41dc-bea9-1b5b4ff74859 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.161743 Jun 16 16:16:06.118702 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-72358338-7ce2-449b-83b3-478c95c82b6e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:06.119939 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-72358338-7ce2-449b-83b3-478c95c82b6e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:06.126718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 263/526] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:05 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:06.133476 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-72358338-7ce2-449b-83b3-478c95c82b6e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:06.134046 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-72358338-7ce2-449b-83b3-478c95c82b6e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:06.134903 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-72358338-7ce2-449b-83b3-478c95c82b6e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:06.141762 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-72358338-7ce2-449b-83b3-478c95c82b6e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:06.286323 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-72358338-7ce2-449b-83b3-478c95c82b6e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:06.300350 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-72358338-7ce2-449b-83b3-478c95c82b6e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.185687 Jun 16 16:16:06.301410 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 264/527] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:06 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:07.132888 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a292ab3e-d98c-429d-89ec-7470b727f047 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:07.133425 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a292ab3e-d98c-429d-89ec-7470b727f047 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:07.140690 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a292ab3e-d98c-429d-89ec-7470b727f047 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:07.141160 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a292ab3e-d98c-429d-89ec-7470b727f047 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:07.141996 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a292ab3e-d98c-429d-89ec-7470b727f047 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:07.142475 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a292ab3e-d98c-429d-89ec-7470b727f047 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:07.282967 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a292ab3e-d98c-429d-89ec-7470b727f047 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:07.290935 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a292ab3e-d98c-429d-89ec-7470b727f047 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.162046 Jun 16 16:16:07.291504 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 264/528] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:07 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:07.316796 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9e3537b7-1be5-4ae5-b566-9684227e79bb tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:07.317414 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9e3537b7-1be5-4ae5-b566-9684227e79bb tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:07.319504 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:07.320179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=12 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:07.326467 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9e3537b7-1be5-4ae5-b566-9684227e79bb tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:07.326913 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9e3537b7-1be5-4ae5-b566-9684227e79bb tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:07.327684 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9e3537b7-1be5-4ae5-b566-9684227e79bb tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:07.328115 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9e3537b7-1be5-4ae5-b566-9684227e79bb tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:07.460659 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9e3537b7-1be5-4ae5-b566-9684227e79bb tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:07.468172 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9e3537b7-1be5-4ae5-b566-9684227e79bb tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.155266 Jun 16 16:16:07.468762 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 265/529] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:07 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:08.308232 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-545df904-9771-47f4-81f2-5c21733394b3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:08.308876 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-545df904-9771-47f4-81f2-5c21733394b3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:08.315524 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-545df904-9771-47f4-81f2-5c21733394b3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:08.315973 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-545df904-9771-47f4-81f2-5c21733394b3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:08.316715 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-545df904-9771-47f4-81f2-5c21733394b3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:08.317151 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-545df904-9771-47f4-81f2-5c21733394b3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:08.460637 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-545df904-9771-47f4-81f2-5c21733394b3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:08.468035 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-545df904-9771-47f4-81f2-5c21733394b3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.163692 Jun 16 16:16:08.468598 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 265/530] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:08 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:08.486876 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5e4718d3-3f6c-4c94-ba80-a175c2038f03 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:08.487548 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5e4718d3-3f6c-4c94-ba80-a175c2038f03 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:08.501173 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5e4718d3-3f6c-4c94-ba80-a175c2038f03 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:08.501843 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5e4718d3-3f6c-4c94-ba80-a175c2038f03 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:08.502632 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5e4718d3-3f6c-4c94-ba80-a175c2038f03 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:08.502869 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5e4718d3-3f6c-4c94-ba80-a175c2038f03 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:08.638877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5e4718d3-3f6c-4c94-ba80-a175c2038f03 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:08.644761 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f33fb5fc-6ed9-4c8f-b0d4-70b04cb443af tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:08.645483 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f33fb5fc-6ed9-4c8f-b0d4-70b04cb443af tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:08.648922 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5e4718d3-3f6c-4c94-ba80-a175c2038f03 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.166691 Jun 16 16:16:08.649638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 266/531] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:08 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:08.653161 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f33fb5fc-6ed9-4c8f-b0d4-70b04cb443af tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:08.653563 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f33fb5fc-6ed9-4c8f-b0d4-70b04cb443af tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:08.654400 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f33fb5fc-6ed9-4c8f-b0d4-70b04cb443af tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:08.654955 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f33fb5fc-6ed9-4c8f-b0d4-70b04cb443af tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:08.786378 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-f33fb5fc-6ed9-4c8f-b0d4-70b04cb443af tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lazy-loading 'services' on Instance uuid aa2fe4ab-2e04-4754-8301-e0c6666f1c61 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:16:08.922288 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f33fb5fc-6ed9-4c8f-b0d4-70b04cb443af tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "DELETE /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61/os-volume_attachments/1ce9c1a8-3aac-469f-854d-bddc2f835cee" status: 202 len: 0 microversion: 2.1 time: 0.281330 Jun 16 16:16:08.922834 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 266/532] 10.222.0.88 () {58 vars in 1415 bytes} [Thu Jun 16 16:16:08 2022] DELETE /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61/os-volume_attachments/1ce9c1a8-3aac-469f-854d-bddc2f835cee => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:16:09.489175 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e01fd2d3-3eff-4f31-b96e-11f3737d4e32 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:09.491045 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e01fd2d3-3eff-4f31-b96e-11f3737d4e32 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:09.498353 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e01fd2d3-3eff-4f31-b96e-11f3737d4e32 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:09.498809 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e01fd2d3-3eff-4f31-b96e-11f3737d4e32 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:09.499582 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e01fd2d3-3eff-4f31-b96e-11f3737d4e32 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:09.500055 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e01fd2d3-3eff-4f31-b96e-11f3737d4e32 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:09.656165 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e01fd2d3-3eff-4f31-b96e-11f3737d4e32 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:09.664284 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e01fd2d3-3eff-4f31-b96e-11f3737d4e32 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.182085 Jun 16 16:16:09.664890 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 267/533] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:09 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:09.669443 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7e00c1c3-537f-41b0-87a2-2599f76ac61b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:09.670937 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7e00c1c3-537f-41b0-87a2-2599f76ac61b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:09.677264 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7e00c1c3-537f-41b0-87a2-2599f76ac61b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:09.677756 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7e00c1c3-537f-41b0-87a2-2599f76ac61b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:09.679092 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7e00c1c3-537f-41b0-87a2-2599f76ac61b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:09.679541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7e00c1c3-537f-41b0-87a2-2599f76ac61b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:09.819727 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7e00c1c3-537f-41b0-87a2-2599f76ac61b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:09.827322 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7e00c1c3-537f-41b0-87a2-2599f76ac61b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.163777 Jun 16 16:16:09.827895 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 267/534] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:09 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:10.680535 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f278a82e-62ec-4999-a97d-d47d8ca6d587 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:10.681101 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f278a82e-62ec-4999-a97d-d47d8ca6d587 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:10.688149 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f278a82e-62ec-4999-a97d-d47d8ca6d587 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:10.688594 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f278a82e-62ec-4999-a97d-d47d8ca6d587 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:10.689343 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f278a82e-62ec-4999-a97d-d47d8ca6d587 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:10.689802 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f278a82e-62ec-4999-a97d-d47d8ca6d587 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:10.708487 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=100 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:10.827767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f278a82e-62ec-4999-a97d-d47d8ca6d587 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:10.835052 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f278a82e-62ec-4999-a97d-d47d8ca6d587 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.158110 Jun 16 16:16:10.835613 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 268/535] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:10 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:10.850026 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-07f7ffa2-b9ea-4a82-a2ca-009a16a7461b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:10.850796 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-07f7ffa2-b9ea-4a82-a2ca-009a16a7461b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:10.858002 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-07f7ffa2-b9ea-4a82-a2ca-009a16a7461b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:10.858454 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-07f7ffa2-b9ea-4a82-a2ca-009a16a7461b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:10.859246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-07f7ffa2-b9ea-4a82-a2ca-009a16a7461b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:10.859697 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-07f7ffa2-b9ea-4a82-a2ca-009a16a7461b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:10.998034 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-07f7ffa2-b9ea-4a82-a2ca-009a16a7461b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:11.005522 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-07f7ffa2-b9ea-4a82-a2ca-009a16a7461b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.159545 Jun 16 16:16:11.006671 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 268/536] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:10 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:11.853308 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-30f9d6f3-314f-4279-bd78-4b5e292968d2 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:11.854018 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-30f9d6f3-314f-4279-bd78-4b5e292968d2 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:11.860814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-30f9d6f3-314f-4279-bd78-4b5e292968d2 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:11.861194 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-30f9d6f3-314f-4279-bd78-4b5e292968d2 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:11.861988 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-30f9d6f3-314f-4279-bd78-4b5e292968d2 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:11.862420 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-30f9d6f3-314f-4279-bd78-4b5e292968d2 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:12.002482 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-30f9d6f3-314f-4279-bd78-4b5e292968d2 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:12.010478 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-30f9d6f3-314f-4279-bd78-4b5e292968d2 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.161460 Jun 16 16:16:12.011833 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 269/537] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:11 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:12.027600 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a1d29421-2e4e-4366-989a-9a37e394e1f8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:12.028827 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a1d29421-2e4e-4366-989a-9a37e394e1f8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:12.035282 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=72 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:12.037104 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a1d29421-2e4e-4366-989a-9a37e394e1f8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:12.038420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a1d29421-2e4e-4366-989a-9a37e394e1f8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:12.039433 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a1d29421-2e4e-4366-989a-9a37e394e1f8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:12.040062 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a1d29421-2e4e-4366-989a-9a37e394e1f8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:12.185980 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a1d29421-2e4e-4366-989a-9a37e394e1f8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:12.196541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a1d29421-2e4e-4366-989a-9a37e394e1f8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.172828 Jun 16 16:16:12.197130 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 269/538] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:12 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:13.028557 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-694883ea-1ddc-4a1a-bb9c-b821d951c423 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:13.029572 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-694883ea-1ddc-4a1a-bb9c-b821d951c423 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:13.036796 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-694883ea-1ddc-4a1a-bb9c-b821d951c423 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:13.037324 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-694883ea-1ddc-4a1a-bb9c-b821d951c423 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:13.038315 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-694883ea-1ddc-4a1a-bb9c-b821d951c423 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:13.038543 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-694883ea-1ddc-4a1a-bb9c-b821d951c423 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:13.196211 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-694883ea-1ddc-4a1a-bb9c-b821d951c423 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:13.203578 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-694883ea-1ddc-4a1a-bb9c-b821d951c423 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.179056 Jun 16 16:16:13.204246 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 270/539] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:13 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:13.214036 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-856ce705-9e24-4935-8701-a8608cb5f53c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:13.214649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-856ce705-9e24-4935-8701-a8608cb5f53c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:13.221505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-856ce705-9e24-4935-8701-a8608cb5f53c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:13.221996 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-856ce705-9e24-4935-8701-a8608cb5f53c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:13.223033 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-856ce705-9e24-4935-8701-a8608cb5f53c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:13.224472 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-856ce705-9e24-4935-8701-a8608cb5f53c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:13.371777 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-856ce705-9e24-4935-8701-a8608cb5f53c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:13.379601 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-856ce705-9e24-4935-8701-a8608cb5f53c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.169376 Jun 16 16:16:13.380177 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 270/540] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:13 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:14.221017 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2a3687ba-f50e-4eff-8cc3-b9c0821709ed tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:14.221598 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2a3687ba-f50e-4eff-8cc3-b9c0821709ed tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:14.229082 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2a3687ba-f50e-4eff-8cc3-b9c0821709ed tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:14.229519 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2a3687ba-f50e-4eff-8cc3-b9c0821709ed tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:14.230312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2a3687ba-f50e-4eff-8cc3-b9c0821709ed tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:14.230732 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2a3687ba-f50e-4eff-8cc3-b9c0821709ed tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:14.371101 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2a3687ba-f50e-4eff-8cc3-b9c0821709ed tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:14.378689 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2a3687ba-f50e-4eff-8cc3-b9c0821709ed tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.161584 Jun 16 16:16:14.379255 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 271/541] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:14 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:14.400533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-79af7297-e510-48d7-b07d-b396a57dd749 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:14.401386 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-79af7297-e510-48d7-b07d-b396a57dd749 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:14.409622 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-79af7297-e510-48d7-b07d-b396a57dd749 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:14.410201 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-79af7297-e510-48d7-b07d-b396a57dd749 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:14.410981 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-79af7297-e510-48d7-b07d-b396a57dd749 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:14.411421 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-79af7297-e510-48d7-b07d-b396a57dd749 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:14.562724 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-79af7297-e510-48d7-b07d-b396a57dd749 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:14.570900 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-79af7297-e510-48d7-b07d-b396a57dd749 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.175313 Jun 16 16:16:14.571412 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 271/542] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:14 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:15.396272 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-672f85e9-d897-438e-b224-20009173ddba tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:15.396796 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-672f85e9-d897-438e-b224-20009173ddba tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:15.402777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-672f85e9-d897-438e-b224-20009173ddba tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:15.403227 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-672f85e9-d897-438e-b224-20009173ddba tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:15.403976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-672f85e9-d897-438e-b224-20009173ddba tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:15.404403 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-672f85e9-d897-438e-b224-20009173ddba tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:15.553761 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-672f85e9-d897-438e-b224-20009173ddba tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:15.561639 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-672f85e9-d897-438e-b224-20009173ddba tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.169927 Jun 16 16:16:15.562266 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 272/543] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:15 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:15.587490 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f50ac565-dd48-4ae7-8059-13ac32c4fc65 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:15.588105 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f50ac565-dd48-4ae7-8059-13ac32c4fc65 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:15.594603 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f50ac565-dd48-4ae7-8059-13ac32c4fc65 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:15.595151 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f50ac565-dd48-4ae7-8059-13ac32c4fc65 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:15.596033 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f50ac565-dd48-4ae7-8059-13ac32c4fc65 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:15.596486 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f50ac565-dd48-4ae7-8059-13ac32c4fc65 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:15.743721 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f50ac565-dd48-4ae7-8059-13ac32c4fc65 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:15.751520 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f50ac565-dd48-4ae7-8059-13ac32c4fc65 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.167783 Jun 16 16:16:15.752082 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 272/544] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:15 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:16.578587 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-06cb5da8-5842-4256-a0ca-65aaa55570e4 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:16.579200 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-06cb5da8-5842-4256-a0ca-65aaa55570e4 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:16.585674 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-06cb5da8-5842-4256-a0ca-65aaa55570e4 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:16.586152 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-06cb5da8-5842-4256-a0ca-65aaa55570e4 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:16.586904 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-06cb5da8-5842-4256-a0ca-65aaa55570e4 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:16.587343 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-06cb5da8-5842-4256-a0ca-65aaa55570e4 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:16.732166 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-06cb5da8-5842-4256-a0ca-65aaa55570e4 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:16.739570 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-06cb5da8-5842-4256-a0ca-65aaa55570e4 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.164794 Jun 16 16:16:16.740172 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 273/545] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:16 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:16.767955 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3e1aa7a9-8c7d-43e0-91af-9340c2161255 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:16.768563 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3e1aa7a9-8c7d-43e0-91af-9340c2161255 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:16.775677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3e1aa7a9-8c7d-43e0-91af-9340c2161255 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:16.776130 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3e1aa7a9-8c7d-43e0-91af-9340c2161255 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:16.776889 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3e1aa7a9-8c7d-43e0-91af-9340c2161255 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:16.777321 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3e1aa7a9-8c7d-43e0-91af-9340c2161255 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:16.921562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3e1aa7a9-8c7d-43e0-91af-9340c2161255 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:16.929228 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3e1aa7a9-8c7d-43e0-91af-9340c2161255 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.165048 Jun 16 16:16:16.929911 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 273/546] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:16 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:17.756292 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0d3a8791-d67f-45ab-bc01-5fbea3b140f7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:17.756923 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0d3a8791-d67f-45ab-bc01-5fbea3b140f7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:17.763419 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0d3a8791-d67f-45ab-bc01-5fbea3b140f7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:17.763857 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0d3a8791-d67f-45ab-bc01-5fbea3b140f7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:17.764602 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0d3a8791-d67f-45ab-bc01-5fbea3b140f7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:17.765031 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0d3a8791-d67f-45ab-bc01-5fbea3b140f7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:17.906838 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0d3a8791-d67f-45ab-bc01-5fbea3b140f7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:17.918927 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0d3a8791-d67f-45ab-bc01-5fbea3b140f7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.166023 Jun 16 16:16:17.919946 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 274/547] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:17 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:17.950839 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-343e000e-8856-41f8-ba16-34f57d5d7e0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:17.952144 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-343e000e-8856-41f8-ba16-34f57d5d7e0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:17.962636 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-343e000e-8856-41f8-ba16-34f57d5d7e0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:17.963088 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-343e000e-8856-41f8-ba16-34f57d5d7e0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:17.963855 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-343e000e-8856-41f8-ba16-34f57d5d7e0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:17.964287 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-343e000e-8856-41f8-ba16-34f57d5d7e0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:18.108245 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-343e000e-8856-41f8-ba16-34f57d5d7e0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:18.115808 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-343e000e-8856-41f8-ba16-34f57d5d7e0b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.173387 Jun 16 16:16:18.116380 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 274/548] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:17 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:18.935793 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6d623918-93f9-4002-943f-465fe8dea943 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:18.937071 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6d623918-93f9-4002-943f-465fe8dea943 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:18.943801 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6d623918-93f9-4002-943f-465fe8dea943 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:18.944261 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6d623918-93f9-4002-943f-465fe8dea943 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:18.945031 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6d623918-93f9-4002-943f-465fe8dea943 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:18.945471 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6d623918-93f9-4002-943f-465fe8dea943 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:19.076277 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6d623918-93f9-4002-943f-465fe8dea943 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:19.083874 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6d623918-93f9-4002-943f-465fe8dea943 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.152006 Jun 16 16:16:19.084437 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 275/549] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:18 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:19.133231 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e58e404e-f7ad-40e4-a2aa-24a6ac6560d4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:19.133959 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e58e404e-f7ad-40e4-a2aa-24a6ac6560d4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:19.141080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e58e404e-f7ad-40e4-a2aa-24a6ac6560d4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:19.141525 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e58e404e-f7ad-40e4-a2aa-24a6ac6560d4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:19.142342 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e58e404e-f7ad-40e4-a2aa-24a6ac6560d4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:19.143448 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e58e404e-f7ad-40e4-a2aa-24a6ac6560d4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:19.280422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e58e404e-f7ad-40e4-a2aa-24a6ac6560d4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:19.288508 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e58e404e-f7ad-40e4-a2aa-24a6ac6560d4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.159942 Jun 16 16:16:19.289089 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 275/550] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:19 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:20.102252 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c2d8c17e-81de-4347-a049-d9289e17bde0 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:20.102858 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c2d8c17e-81de-4347-a049-d9289e17bde0 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:20.109427 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c2d8c17e-81de-4347-a049-d9289e17bde0 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:20.109906 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c2d8c17e-81de-4347-a049-d9289e17bde0 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:20.110669 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c2d8c17e-81de-4347-a049-d9289e17bde0 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:20.111090 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c2d8c17e-81de-4347-a049-d9289e17bde0 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:20.244029 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c2d8c17e-81de-4347-a049-d9289e17bde0 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:20.251559 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c2d8c17e-81de-4347-a049-d9289e17bde0 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.153909 Jun 16 16:16:20.252056 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 276/551] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:20 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:20.305561 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-61fdc249-ee22-4485-8942-03014dd5cca5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:20.306204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-61fdc249-ee22-4485-8942-03014dd5cca5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:20.312616 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61fdc249-ee22-4485-8942-03014dd5cca5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:20.313061 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61fdc249-ee22-4485-8942-03014dd5cca5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:20.314159 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61fdc249-ee22-4485-8942-03014dd5cca5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:20.314596 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61fdc249-ee22-4485-8942-03014dd5cca5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:20.452562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-61fdc249-ee22-4485-8942-03014dd5cca5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:20.460586 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-61fdc249-ee22-4485-8942-03014dd5cca5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.158976 Jun 16 16:16:20.461079 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 276/552] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:20 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:21.268106 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-66969c3c-4f7c-44a8-80c6-ad51622c5410 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:21.268747 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-66969c3c-4f7c-44a8-80c6-ad51622c5410 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:21.275442 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-66969c3c-4f7c-44a8-80c6-ad51622c5410 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:21.275890 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-66969c3c-4f7c-44a8-80c6-ad51622c5410 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:21.276653 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-66969c3c-4f7c-44a8-80c6-ad51622c5410 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:21.277088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-66969c3c-4f7c-44a8-80c6-ad51622c5410 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:21.409538 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-66969c3c-4f7c-44a8-80c6-ad51622c5410 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:21.416990 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-66969c3c-4f7c-44a8-80c6-ad51622c5410 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.152747 Jun 16 16:16:21.417567 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 277/553] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:21 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:21.477846 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0d63ccf2-d245-43a1-8a4d-4b2d3aa1f69f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:21.478521 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0d63ccf2-d245-43a1-8a4d-4b2d3aa1f69f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:21.484892 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0d63ccf2-d245-43a1-8a4d-4b2d3aa1f69f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:21.485343 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0d63ccf2-d245-43a1-8a4d-4b2d3aa1f69f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:21.486215 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0d63ccf2-d245-43a1-8a4d-4b2d3aa1f69f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:21.486645 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0d63ccf2-d245-43a1-8a4d-4b2d3aa1f69f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:21.504487 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:21.620573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0d63ccf2-d245-43a1-8a4d-4b2d3aa1f69f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:21.628104 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0d63ccf2-d245-43a1-8a4d-4b2d3aa1f69f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.154286 Jun 16 16:16:21.628672 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 277/554] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:21 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:22.436844 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f6e6dc48-1833-4394-970e-b5324240a0e5 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:22.437467 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f6e6dc48-1833-4394-970e-b5324240a0e5 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:22.443771 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f6e6dc48-1833-4394-970e-b5324240a0e5 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:22.444483 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f6e6dc48-1833-4394-970e-b5324240a0e5 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:22.445243 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f6e6dc48-1833-4394-970e-b5324240a0e5 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:22.445674 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f6e6dc48-1833-4394-970e-b5324240a0e5 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:22.644421 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e7f3a527-e394-41c8-a95a-077d51bb4645 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:22.645149 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e7f3a527-e394-41c8-a95a-077d51bb4645 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:22.652797 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e7f3a527-e394-41c8-a95a-077d51bb4645 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:22.653542 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e7f3a527-e394-41c8-a95a-077d51bb4645 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:22.654541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e7f3a527-e394-41c8-a95a-077d51bb4645 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:22.655047 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e7f3a527-e394-41c8-a95a-077d51bb4645 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:22.680324 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f6e6dc48-1833-4394-970e-b5324240a0e5 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:22.688917 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f6e6dc48-1833-4394-970e-b5324240a0e5 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.258848 Jun 16 16:16:22.689823 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 278/555] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:22 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:22.929823 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e7f3a527-e394-41c8-a95a-077d51bb4645 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:22.937205 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e7f3a527-e394-41c8-a95a-077d51bb4645 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.296684 Jun 16 16:16:22.937798 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 278/556] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:22 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:23.670802 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-0042b62c-3e64-4ec6-878b-5cd7757feb51 req-cd89b067-7a88-43bb-9786-6aa4bc7e87e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "487bea5d-3ad7-4404-9b92-e6b60bc9cf2d", "tag": "fad2c47a-ebb1-49bb-9bf9-18b302cdf9ab"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:23.686053 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-0042b62c-3e64-4ec6-878b-5cd7757feb51 req-cd89b067-7a88-43bb-9786-6aa4bc7e87e6 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:23.686835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-0042b62c-3e64-4ec6-878b-5cd7757feb51 req-cd89b067-7a88-43bb-9786-6aa4bc7e87e6 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:23.707744 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-180f0550-de6b-46ef-90b6-d45d792ad11c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:23.712360 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-180f0550-de6b-46ef-90b6-d45d792ad11c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:23.725875 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-180f0550-de6b-46ef-90b6-d45d792ad11c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:23.728362 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-0042b62c-3e64-4ec6-878b-5cd7757feb51 req-cd89b067-7a88-43bb-9786-6aa4bc7e87e6 service nova] Creating event network-changed:fad2c47a-ebb1-49bb-9bf9-18b302cdf9ab for instance 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d on hv-cinder-83735 Jun 16 16:16:23.733222 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-180f0550-de6b-46ef-90b6-d45d792ad11c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:23.734118 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-180f0550-de6b-46ef-90b6-d45d792ad11c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:23.734537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-180f0550-de6b-46ef-90b6-d45d792ad11c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:23.736480 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-0042b62c-3e64-4ec6-878b-5cd7757feb51 req-cd89b067-7a88-43bb-9786-6aa4bc7e87e6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069591 Jun 16 16:16:23.742862 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 279/557] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:23.835815 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d03b1a65-77d1-4e85-ae0a-a666ec7270fb tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:23.836625 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d03b1a65-77d1-4e85-ae0a-a666ec7270fb tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:23.853899 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d03b1a65-77d1-4e85-ae0a-a666ec7270fb tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:23.854644 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d03b1a65-77d1-4e85-ae0a-a666ec7270fb tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:23.855592 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d03b1a65-77d1-4e85-ae0a-a666ec7270fb tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:23.856314 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d03b1a65-77d1-4e85-ae0a-a666ec7270fb tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:23.886508 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d03b1a65-77d1-4e85-ae0a-a666ec7270fb tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:16:23.963953 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-180f0550-de6b-46ef-90b6-d45d792ad11c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:23.968654 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d03b1a65-77d1-4e85-ae0a-a666ec7270fb tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "DELETE /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 204 len: 0 microversion: 2.1 time: 0.136909 Jun 16 16:16:23.969334 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 280/558] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:16:23 2022] DELETE /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:16:23.975525 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b3411a61-1da7-4d68-b478-f64f83a5a406 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:23.976121 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-180f0550-de6b-46ef-90b6-d45d792ad11c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.272228 Jun 16 16:16:23.976241 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b3411a61-1da7-4d68-b478-f64f83a5a406 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:23.976706 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 279/559] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:23 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:23.982245 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b3411a61-1da7-4d68-b478-f64f83a5a406 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:23.982696 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b3411a61-1da7-4d68-b478-f64f83a5a406 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:23.983579 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b3411a61-1da7-4d68-b478-f64f83a5a406 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:23.984022 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b3411a61-1da7-4d68-b478-f64f83a5a406 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:23.985528 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-033a91df-baeb-4dda-be21-bbe054f22b58 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:23.986176 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-033a91df-baeb-4dda-be21-bbe054f22b58 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:23.993086 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-033a91df-baeb-4dda-be21-bbe054f22b58 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:23.993536 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-033a91df-baeb-4dda-be21-bbe054f22b58 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:23.994421 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-033a91df-baeb-4dda-be21-bbe054f22b58 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:23.994857 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-033a91df-baeb-4dda-be21-bbe054f22b58 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:24.184352 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b3411a61-1da7-4d68-b478-f64f83a5a406 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:24.187874 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-033a91df-baeb-4dda-be21-bbe054f22b58 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:24.192141 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b3411a61-1da7-4d68-b478-f64f83a5a406 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.221513 Jun 16 16:16:24.192715 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 281/560] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:23 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:24.196760 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-033a91df-baeb-4dda-be21-bbe054f22b58 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1559 microversion: 2.1 time: 0.219063 Jun 16 16:16:24.197326 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 280/561] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:23 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:24.992895 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-dd8f96b8-2b90-4682-b6d8-c2ab0f1756a8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:24.993461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-dd8f96b8-2b90-4682-b6d8-c2ab0f1756a8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:25.000052 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dd8f96b8-2b90-4682-b6d8-c2ab0f1756a8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:25.000509 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dd8f96b8-2b90-4682-b6d8-c2ab0f1756a8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:25.001285 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dd8f96b8-2b90-4682-b6d8-c2ab0f1756a8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:25.001792 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dd8f96b8-2b90-4682-b6d8-c2ab0f1756a8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:25.134807 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-dd8f96b8-2b90-4682-b6d8-c2ab0f1756a8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:25.143156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-dd8f96b8-2b90-4682-b6d8-c2ab0f1756a8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.153818 Jun 16 16:16:25.143388 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 282/562] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:24 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:25.210598 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e68d421a-0caa-4c4b-86db-bd27b16ab20d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:25.211373 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e68d421a-0caa-4c4b-86db-bd27b16ab20d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:25.214148 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-99d843a9-fb1f-4455-8712-aa83b9f7a31b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:25.214778 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-99d843a9-fb1f-4455-8712-aa83b9f7a31b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:25.218350 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e68d421a-0caa-4c4b-86db-bd27b16ab20d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:25.218805 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e68d421a-0caa-4c4b-86db-bd27b16ab20d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:25.219660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e68d421a-0caa-4c4b-86db-bd27b16ab20d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:25.220011 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e68d421a-0caa-4c4b-86db-bd27b16ab20d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:25.220763 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-99d843a9-fb1f-4455-8712-aa83b9f7a31b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:25.221203 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-99d843a9-fb1f-4455-8712-aa83b9f7a31b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:25.222020 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-99d843a9-fb1f-4455-8712-aa83b9f7a31b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:25.222713 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-99d843a9-fb1f-4455-8712-aa83b9f7a31b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:25.425659 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e68d421a-0caa-4c4b-86db-bd27b16ab20d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:25.430287 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-99d843a9-fb1f-4455-8712-aa83b9f7a31b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:25.433389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e68d421a-0caa-4c4b-86db-bd27b16ab20d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.227316 Jun 16 16:16:25.433997 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 281/563] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:25 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:25.438309 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-99d843a9-fb1f-4455-8712-aa83b9f7a31b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1559 microversion: 2.1 time: 0.228340 Jun 16 16:16:25.438877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 283/564] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:25 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1559 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:26.160168 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7e7284bc-6cd9-4a95-aceb-0e3bd6065bdd tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:26.160778 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7e7284bc-6cd9-4a95-aceb-0e3bd6065bdd tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:26.167623 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7e7284bc-6cd9-4a95-aceb-0e3bd6065bdd tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:26.168076 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7e7284bc-6cd9-4a95-aceb-0e3bd6065bdd tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:26.168839 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7e7284bc-6cd9-4a95-aceb-0e3bd6065bdd tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:26.169275 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7e7284bc-6cd9-4a95-aceb-0e3bd6065bdd tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:26.299043 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7e7284bc-6cd9-4a95-aceb-0e3bd6065bdd tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:26.306541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7e7284bc-6cd9-4a95-aceb-0e3bd6065bdd tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.150227 Jun 16 16:16:26.307110 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 282/565] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:26 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:26.450429 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8513ab6b-53be-4b74-9d38-bce92b76634b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:26.450985 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8513ab6b-53be-4b74-9d38-bce92b76634b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:26.455338 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6a547928-555f-4d37-b1b9-d8f45547d466 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:26.455949 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6a547928-555f-4d37-b1b9-d8f45547d466 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:26.457505 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8513ab6b-53be-4b74-9d38-bce92b76634b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:26.457989 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8513ab6b-53be-4b74-9d38-bce92b76634b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:26.458755 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8513ab6b-53be-4b74-9d38-bce92b76634b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:26.459190 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8513ab6b-53be-4b74-9d38-bce92b76634b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:26.461877 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6a547928-555f-4d37-b1b9-d8f45547d466 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:26.462336 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6a547928-555f-4d37-b1b9-d8f45547d466 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:26.463093 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6a547928-555f-4d37-b1b9-d8f45547d466 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:26.463244 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:26.463886 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6a547928-555f-4d37-b1b9-d8f45547d466 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:26.659453 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6a547928-555f-4d37-b1b9-d8f45547d466 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:26.663159 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8513ab6b-53be-4b74-9d38-bce92b76634b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:26.668181 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6a547928-555f-4d37-b1b9-d8f45547d466 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1559 microversion: 2.1 time: 0.216566 Jun 16 16:16:26.668858 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 283/566] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:26 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:26.670823 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8513ab6b-53be-4b74-9d38-bce92b76634b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.224288 Jun 16 16:16:26.671394 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 284/567] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:26 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:27.324022 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-98cf6520-646e-4f56-a53f-70d72d7037cf tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:27.324623 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-98cf6520-646e-4f56-a53f-70d72d7037cf tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:27.331273 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-98cf6520-646e-4f56-a53f-70d72d7037cf tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:27.331716 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-98cf6520-646e-4f56-a53f-70d72d7037cf tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:27.332472 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-98cf6520-646e-4f56-a53f-70d72d7037cf tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:27.332903 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-98cf6520-646e-4f56-a53f-70d72d7037cf tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:27.460517 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-98cf6520-646e-4f56-a53f-70d72d7037cf tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:27.468295 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-98cf6520-646e-4f56-a53f-70d72d7037cf tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.148090 Jun 16 16:16:27.468862 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 284/568] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:27 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:27.686348 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cf2f2bd4-a451-4a3c-8614-a3545a66c120 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:27.686898 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-cf2f2bd4-a451-4a3c-8614-a3545a66c120 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:27.687628 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a4920c2a-43c7-46ff-aae1-4177a65e1887 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:27.688238 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a4920c2a-43c7-46ff-aae1-4177a65e1887 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:27.689372 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:27.694417 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a4920c2a-43c7-46ff-aae1-4177a65e1887 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:27.694841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cf2f2bd4-a451-4a3c-8614-a3545a66c120 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:27.694954 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a4920c2a-43c7-46ff-aae1-4177a65e1887 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:27.695286 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cf2f2bd4-a451-4a3c-8614-a3545a66c120 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:27.695620 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a4920c2a-43c7-46ff-aae1-4177a65e1887 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:27.696040 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cf2f2bd4-a451-4a3c-8614-a3545a66c120 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:27.696147 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a4920c2a-43c7-46ff-aae1-4177a65e1887 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:27.696469 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cf2f2bd4-a451-4a3c-8614-a3545a66c120 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:28.114201 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a4920c2a-43c7-46ff-aae1-4177a65e1887 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:28.127134 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a4920c2a-43c7-46ff-aae1-4177a65e1887 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.443156 Jun 16 16:16:28.131306 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 285/569] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:27 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:28.150841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cf2f2bd4-a451-4a3c-8614-a3545a66c120 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:28.160936 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cf2f2bd4-a451-4a3c-8614-a3545a66c120 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1513 microversion: 2.1 time: 0.478353 Jun 16 16:16:28.161522 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 285/570] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:27 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1513 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:28.486142 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f0fa697b-b5e1-4c96-b98e-f35315d02d3c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:28.486775 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f0fa697b-b5e1-4c96-b98e-f35315d02d3c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:28.493493 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f0fa697b-b5e1-4c96-b98e-f35315d02d3c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:28.493967 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f0fa697b-b5e1-4c96-b98e-f35315d02d3c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:28.494728 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f0fa697b-b5e1-4c96-b98e-f35315d02d3c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:28.495158 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f0fa697b-b5e1-4c96-b98e-f35315d02d3c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:28.706420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f0fa697b-b5e1-4c96-b98e-f35315d02d3c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:28.714518 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f0fa697b-b5e1-4c96-b98e-f35315d02d3c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.232408 Jun 16 16:16:28.715096 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 286/571] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:28 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:29.147112 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5a6d26d7-dd7e-45f1-b8fb-18462ee1040c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:29.147719 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5a6d26d7-dd7e-45f1-b8fb-18462ee1040c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:29.154185 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5a6d26d7-dd7e-45f1-b8fb-18462ee1040c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:29.154629 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5a6d26d7-dd7e-45f1-b8fb-18462ee1040c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:29.155381 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5a6d26d7-dd7e-45f1-b8fb-18462ee1040c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:29.155865 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5a6d26d7-dd7e-45f1-b8fb-18462ee1040c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:29.178145 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ba928cbd-69a2-4482-bf26-4921c4a0b7c5 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:29.179334 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ba928cbd-69a2-4482-bf26-4921c4a0b7c5 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:29.186084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ba928cbd-69a2-4482-bf26-4921c4a0b7c5 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:29.186551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ba928cbd-69a2-4482-bf26-4921c4a0b7c5 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:29.187312 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ba928cbd-69a2-4482-bf26-4921c4a0b7c5 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:29.187754 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ba928cbd-69a2-4482-bf26-4921c4a0b7c5 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:29.360567 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5a6d26d7-dd7e-45f1-b8fb-18462ee1040c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:29.364796 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ba928cbd-69a2-4482-bf26-4921c4a0b7c5 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:29.369417 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5a6d26d7-dd7e-45f1-b8fb-18462ee1040c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.226576 Jun 16 16:16:29.370035 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 286/572] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:29 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:29.372380 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ba928cbd-69a2-4482-bf26-4921c4a0b7c5 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1513 microversion: 2.1 time: 0.198131 Jun 16 16:16:29.372938 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 287/573] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:29 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:29.731003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-85a23ab6-7406-4ca3-9a21-c64ba1aba3b7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:29.731606 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-85a23ab6-7406-4ca3-9a21-c64ba1aba3b7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:29.737945 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-85a23ab6-7406-4ca3-9a21-c64ba1aba3b7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:29.738389 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-85a23ab6-7406-4ca3-9a21-c64ba1aba3b7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:29.739134 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-85a23ab6-7406-4ca3-9a21-c64ba1aba3b7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:29.739561 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-85a23ab6-7406-4ca3-9a21-c64ba1aba3b7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:29.872757 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-85a23ab6-7406-4ca3-9a21-c64ba1aba3b7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:29.880512 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-85a23ab6-7406-4ca3-9a21-c64ba1aba3b7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.153291 Jun 16 16:16:29.881087 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 287/574] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:29 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:30.387817 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c32f616d-2fd3-4a82-9ea1-eb48e6887af1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:30.388413 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-01006985-8858-4a85-bb0c-c93380a8a09e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:30.388782 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c32f616d-2fd3-4a82-9ea1-eb48e6887af1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:30.388874 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-01006985-8858-4a85-bb0c-c93380a8a09e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:30.395643 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01006985-8858-4a85-bb0c-c93380a8a09e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:30.396059 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01006985-8858-4a85-bb0c-c93380a8a09e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:30.396975 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c32f616d-2fd3-4a82-9ea1-eb48e6887af1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:30.397364 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01006985-8858-4a85-bb0c-c93380a8a09e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:30.397470 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c32f616d-2fd3-4a82-9ea1-eb48e6887af1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:30.397808 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01006985-8858-4a85-bb0c-c93380a8a09e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:30.398221 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c32f616d-2fd3-4a82-9ea1-eb48e6887af1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:30.398660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c32f616d-2fd3-4a82-9ea1-eb48e6887af1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:30.591235 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-01006985-8858-4a85-bb0c-c93380a8a09e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:30.595203 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c32f616d-2fd3-4a82-9ea1-eb48e6887af1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:30.599820 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-01006985-8858-4a85-bb0c-c93380a8a09e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1513 microversion: 2.1 time: 0.214748 Jun 16 16:16:30.600395 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 288/575] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:30 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:30.603496 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c32f616d-2fd3-4a82-9ea1-eb48e6887af1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.220238 Jun 16 16:16:30.604075 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 288/576] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:30 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:30.843351 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-199a9308-74ea-43db-85e6-d7215c9834e9 req-3ae255d3-9699-4521-9d40-7e3c0c72031e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bac54eb-7ea8-4c97-a1f1-7c1da22baccd", "name": "network-vif-plugged", "status": "completed", "tag": "620a39ba-f7e2-4ae1-acf0-e87136dc559c"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:30.853236 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-199a9308-74ea-43db-85e6-d7215c9834e9 req-3ae255d3-9699-4521-9d40-7e3c0c72031e service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:30.853672 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-199a9308-74ea-43db-85e6-d7215c9834e9 req-3ae255d3-9699-4521-9d40-7e3c0c72031e service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:30.866716 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-199a9308-74ea-43db-85e6-d7215c9834e9 req-3ae255d3-9699-4521-9d40-7e3c0c72031e service nova] Creating event network-vif-plugged:620a39ba-f7e2-4ae1-acf0-e87136dc559c for instance 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd on hv-cinder-83735 Jun 16 16:16:30.872161 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-199a9308-74ea-43db-85e6-d7215c9834e9 req-3ae255d3-9699-4521-9d40-7e3c0c72031e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032996 Jun 16 16:16:30.872758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 289/577] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:30.897140 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b72c0411-c218-4224-9e44-8eba5a9eee30 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:30.897771 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b72c0411-c218-4224-9e44-8eba5a9eee30 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:30.903907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b72c0411-c218-4224-9e44-8eba5a9eee30 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:30.904367 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b72c0411-c218-4224-9e44-8eba5a9eee30 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:30.905135 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b72c0411-c218-4224-9e44-8eba5a9eee30 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:30.905575 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b72c0411-c218-4224-9e44-8eba5a9eee30 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:31.040496 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b72c0411-c218-4224-9e44-8eba5a9eee30 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:31.047862 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b72c0411-c218-4224-9e44-8eba5a9eee30 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.155204 Jun 16 16:16:31.048422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 289/578] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:30 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:31.617271 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e16f5e2e-34a4-43c7-97f7-c4b4f53054b4 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:31.618049 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e16f5e2e-34a4-43c7-97f7-c4b4f53054b4 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:31.620377 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-82b14542-24af-41a0-9d03-c69d74b7d7de tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:31.620990 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-82b14542-24af-41a0-9d03-c69d74b7d7de tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:31.625044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e16f5e2e-34a4-43c7-97f7-c4b4f53054b4 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:31.625491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e16f5e2e-34a4-43c7-97f7-c4b4f53054b4 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:31.626290 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e16f5e2e-34a4-43c7-97f7-c4b4f53054b4 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:31.626725 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e16f5e2e-34a4-43c7-97f7-c4b4f53054b4 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:31.627919 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-82b14542-24af-41a0-9d03-c69d74b7d7de tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:31.628506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-82b14542-24af-41a0-9d03-c69d74b7d7de tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:31.629321 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-82b14542-24af-41a0-9d03-c69d74b7d7de tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:31.629777 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-82b14542-24af-41a0-9d03-c69d74b7d7de tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:31.834066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e16f5e2e-34a4-43c7-97f7-c4b4f53054b4 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:31.837502 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-82b14542-24af-41a0-9d03-c69d74b7d7de tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:31.842082 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e16f5e2e-34a4-43c7-97f7-c4b4f53054b4 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1513 microversion: 2.1 time: 0.228922 Jun 16 16:16:31.842988 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 290/579] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:31 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:31.845147 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-82b14542-24af-41a0-9d03-c69d74b7d7de tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.228684 Jun 16 16:16:31.845705 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 290/580] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:31 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:32.065675 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b948bd90-760c-4dbf-bef3-4f0140464612 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:32.066316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b948bd90-760c-4dbf-bef3-4f0140464612 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:32.072819 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b948bd90-760c-4dbf-bef3-4f0140464612 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:32.073261 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b948bd90-760c-4dbf-bef3-4f0140464612 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:32.074050 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b948bd90-760c-4dbf-bef3-4f0140464612 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:32.074482 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b948bd90-760c-4dbf-bef3-4f0140464612 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:32.205800 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b948bd90-760c-4dbf-bef3-4f0140464612 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:32.213615 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b948bd90-760c-4dbf-bef3-4f0140464612 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.151739 Jun 16 16:16:32.214209 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 291/581] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:32 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:32.859622 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-adcf0e33-6e1f-4c9e-9161-1e68e74e1d44 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:32.860175 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-adcf0e33-6e1f-4c9e-9161-1e68e74e1d44 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:32.862106 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7efa36a1-0443-4ca3-a368-892a530b96d9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:32.862829 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7efa36a1-0443-4ca3-a368-892a530b96d9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:32.868117 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-adcf0e33-6e1f-4c9e-9161-1e68e74e1d44 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:32.868578 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-adcf0e33-6e1f-4c9e-9161-1e68e74e1d44 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:32.869359 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-adcf0e33-6e1f-4c9e-9161-1e68e74e1d44 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:32.869843 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-adcf0e33-6e1f-4c9e-9161-1e68e74e1d44 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:32.871380 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7efa36a1-0443-4ca3-a368-892a530b96d9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:32.871938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7efa36a1-0443-4ca3-a368-892a530b96d9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:32.872811 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7efa36a1-0443-4ca3-a368-892a530b96d9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:32.873347 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7efa36a1-0443-4ca3-a368-892a530b96d9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:33.303974 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7efa36a1-0443-4ca3-a368-892a530b96d9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:33.311916 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7efa36a1-0443-4ca3-a368-892a530b96d9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.453822 Jun 16 16:16:33.312495 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 292/582] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:32 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:33.317124 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-23d619ff-53f8-4852-b603-2c66122f3464 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:33.318616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-23d619ff-53f8-4852-b603-2c66122f3464 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:33.326571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-23d619ff-53f8-4852-b603-2c66122f3464 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:33.327022 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-23d619ff-53f8-4852-b603-2c66122f3464 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:33.327790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-23d619ff-53f8-4852-b603-2c66122f3464 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:33.328228 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-23d619ff-53f8-4852-b603-2c66122f3464 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:33.366175 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-adcf0e33-6e1f-4c9e-9161-1e68e74e1d44 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:33.373695 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-adcf0e33-6e1f-4c9e-9161-1e68e74e1d44 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1513 microversion: 2.1 time: 0.518095 Jun 16 16:16:33.374293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 291/583] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:32 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1513 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:33.545996 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-23d619ff-53f8-4852-b603-2c66122f3464 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:33.554549 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-23d619ff-53f8-4852-b603-2c66122f3464 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.241026 Jun 16 16:16:33.555133 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 293/584] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:33 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:33.752291 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-309ee0bf-3282-4563-845c-eb4fa5a4b5ed req-fc26e1a6-5ec7-48b7-922c-87911b6ed5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2fe4ab-2e04-4754-8301-e0c6666f1c61", "name": "network-vif-deleted", "tag": "3f5a0aae-f27d-4b24-94b2-031c768b687b"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:33.760556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-309ee0bf-3282-4563-845c-eb4fa5a4b5ed req-fc26e1a6-5ec7-48b7-922c-87911b6ed5c8 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:33.760997 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-309ee0bf-3282-4563-845c-eb4fa5a4b5ed req-fc26e1a6-5ec7-48b7-922c-87911b6ed5c8 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:33.772961 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-309ee0bf-3282-4563-845c-eb4fa5a4b5ed req-fc26e1a6-5ec7-48b7-922c-87911b6ed5c8 service nova] Creating event network-vif-deleted:3f5a0aae-f27d-4b24-94b2-031c768b687b for instance aa2fe4ab-2e04-4754-8301-e0c6666f1c61 on hv-cinder-83735 Jun 16 16:16:33.778149 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-309ee0bf-3282-4563-845c-eb4fa5a4b5ed req-fc26e1a6-5ec7-48b7-922c-87911b6ed5c8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029497 Jun 16 16:16:33.778774 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 292/585] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:34.329514 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4c9316de-0c87-4707-bd9f-69dc9d3b8903 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:34.330121 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4c9316de-0c87-4707-bd9f-69dc9d3b8903 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:34.336834 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4c9316de-0c87-4707-bd9f-69dc9d3b8903 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:34.337277 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4c9316de-0c87-4707-bd9f-69dc9d3b8903 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:34.338062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4c9316de-0c87-4707-bd9f-69dc9d3b8903 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:34.338497 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4c9316de-0c87-4707-bd9f-69dc9d3b8903 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:34.391249 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c0630c60-b730-43d1-9e69-edcda8c5c863 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:34.391875 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c0630c60-b730-43d1-9e69-edcda8c5c863 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:34.398704 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c0630c60-b730-43d1-9e69-edcda8c5c863 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:34.399151 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c0630c60-b730-43d1-9e69-edcda8c5c863 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:34.399916 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c0630c60-b730-43d1-9e69-edcda8c5c863 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:34.400347 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c0630c60-b730-43d1-9e69-edcda8c5c863 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:34.481199 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c0630c60-b730-43d1-9e69-edcda8c5c863 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:34.488723 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c0630c60-b730-43d1-9e69-edcda8c5c863 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1304 microversion: 2.1 time: 0.101728 Jun 16 16:16:34.489300 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 293/586] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:34 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:34.502562 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4c9316de-0c87-4707-bd9f-69dc9d3b8903 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:34.510048 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4c9316de-0c87-4707-bd9f-69dc9d3b8903 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.184554 Jun 16 16:16:34.510617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 294/587] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:34 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:34.570854 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9c05e406-40db-43a1-8be7-19e6e40d9f16 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:34.571458 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9c05e406-40db-43a1-8be7-19e6e40d9f16 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:34.579558 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c05e406-40db-43a1-8be7-19e6e40d9f16 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:34.580132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c05e406-40db-43a1-8be7-19e6e40d9f16 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:34.580933 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c05e406-40db-43a1-8be7-19e6e40d9f16 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:34.581601 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c05e406-40db-43a1-8be7-19e6e40d9f16 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:34.716672 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9c05e406-40db-43a1-8be7-19e6e40d9f16 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:34.723231 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=100 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:34.730635 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9c05e406-40db-43a1-8be7-19e6e40d9f16 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.163182 Jun 16 16:16:34.731394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 294/588] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:34 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:35.505962 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9dda3089-1f82-49f9-86a1-a578ccd146a6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:35.506583 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9dda3089-1f82-49f9-86a1-a578ccd146a6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:35.513365 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9dda3089-1f82-49f9-86a1-a578ccd146a6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:35.513855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9dda3089-1f82-49f9-86a1-a578ccd146a6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:35.514632 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9dda3089-1f82-49f9-86a1-a578ccd146a6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:35.515069 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9dda3089-1f82-49f9-86a1-a578ccd146a6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:35.526939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-936f2d31-3ff8-4895-a197-564e09289685 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:35.527549 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-936f2d31-3ff8-4895-a197-564e09289685 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:35.534283 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-936f2d31-3ff8-4895-a197-564e09289685 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:35.534729 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-936f2d31-3ff8-4895-a197-564e09289685 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:35.535519 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-936f2d31-3ff8-4895-a197-564e09289685 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:35.535939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-936f2d31-3ff8-4895-a197-564e09289685 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:35.546575 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9dda3089-1f82-49f9-86a1-a578ccd146a6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:35.547061 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9dda3089-1f82-49f9-86a1-a578ccd146a6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:35.547511 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-9dda3089-1f82-49f9-86a1-a578ccd146a6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lazy-loading 'fault' on Instance uuid aa2fe4ab-2e04-4754-8301-e0c6666f1c61 {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:16:35.599440 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9dda3089-1f82-49f9-86a1-a578ccd146a6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:35.609494 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9dda3089-1f82-49f9-86a1-a578ccd146a6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 200 len: 1309 microversion: 2.1 time: 0.107872 Jun 16 16:16:35.610432 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 295/589] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:35 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:35.692002 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-936f2d31-3ff8-4895-a197-564e09289685 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:35.699373 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-936f2d31-3ff8-4895-a197-564e09289685 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1371 microversion: 2.1 time: 0.176216 Jun 16 16:16:35.699941 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 295/590] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:35 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:35.748281 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d81440f8-3334-4a6d-9fe6-2a669eeec076 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:35.748931 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d81440f8-3334-4a6d-9fe6-2a669eeec076 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:35.755737 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d81440f8-3334-4a6d-9fe6-2a669eeec076 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:35.756288 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d81440f8-3334-4a6d-9fe6-2a669eeec076 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:35.757194 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d81440f8-3334-4a6d-9fe6-2a669eeec076 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:35.757779 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d81440f8-3334-4a6d-9fe6-2a669eeec076 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:35.893252 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d81440f8-3334-4a6d-9fe6-2a669eeec076 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:35.900889 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d81440f8-3334-4a6d-9fe6-2a669eeec076 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.157334 Jun 16 16:16:35.901452 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 296/591] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:35 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:36.629293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f1d5d508-4ee8-490b-a15d-8b1403e776d2 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:36.630735 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f1d5d508-4ee8-490b-a15d-8b1403e776d2 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: aa2fe4ab-2e04-4754-8301-e0c6666f1c61] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:36.637287 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f1d5d508-4ee8-490b-a15d-8b1403e776d2 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:36.637740 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f1d5d508-4ee8-490b-a15d-8b1403e776d2 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:36.638504 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f1d5d508-4ee8-490b-a15d-8b1403e776d2 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:36.638941 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f1d5d508-4ee8-490b-a15d-8b1403e776d2 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:36.652358 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-f1d5d508-4ee8-490b-a15d-8b1403e776d2 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] HTTP exception thrown: Instance aa2fe4ab-2e04-4754-8301-e0c6666f1c61 could not be found. Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f1d5d508-4ee8-490b-a15d-8b1403e776d2 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Request method failure captured: Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 HTTP/1.1 Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1a5kByetA5LRErMKGDqozeUBDW287QigK5V8LF1pJt-CA4btu9QKzReck9B_tbslwej1xP9d-CYt1hOGQP3SCiZVJ89gzAVpO1FVz-v3VHTTVtsOnkQ8QwL6VQS8hf1xVB0dOcXg7iFDN30z1aE3rQKQnQhI3IP2IrOKt4kSCZqpmw Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: f5e363bcf5ed47529b6464cf954a31ea Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesSnapshotTestJSON-261890931 Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:16:36.654017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:16:36.655628 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f5e363bcf5ed47529b6464cf954a31ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f5e363bcf5ed47529b6464cf954a31ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f5e363bcf5ed47529b6464cf954a31ea", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f5e363bcf5ed47529b6464cf954a31ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:16:36.655628 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesSnapshotTestJSON-261890931 Jun 16 16:16:36.655628 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: f5e363bcf5ed47529b6464cf954a31ea Jun 16 16:16:36.655628 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-261890931 Jun 16 16:16:36.655628 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesSnapshotTestJSON-261890931-project Jun 16 16:16:36.655628 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:16:36.655628 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:16:36.655628 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: 1a98ea9b90174a24b57b3875e9df2ecd Jun 16 16:16:36.655628 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesSnapshotTestJSON-261890931-project Jun 16 16:16:36.655628 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:16:36.655628 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Instance aa2fe4ab-2e04-4754-8301-e0c6666f1c61 could not be found. Jun 16 16:16:36.655628 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': 'aa2fe4ab-2e04-4754-8301-e0c6666f1c61'} Jun 16 16:16:36.656573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:16:36.656573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:16:36.656573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:16:36.656573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:16:36.656573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:16:36.656573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:16:36.656573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:16:36.656573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:16:36.656573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:16:36.656573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:16:36.656573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa2fe4ab-2e04-4754-8301-e0c6666f1c61 could not be found. Jun 16 16:16:36.656573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:16:36.656573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:16:36.656573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:16:36.656573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:16:36.656573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:16:36.656573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:16:36.656573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:16:36.656573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:16:36.656573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:16:36.658094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:16:36.658094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:16:36.658094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:16:36.658094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:16:36.658094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:16:36.658094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:16:36.658094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:16:36.658094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa2fe4ab-2e04-4754-8301-e0c6666f1c61 could not be found. Jun 16 16:16:36.658094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:16:36.658094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:16:36.658094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:16:36.658094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:16:36.658094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:16:36.658094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:16:36.658094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:16:36.658094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:16:36.658094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa2fe4ab-2e04-4754-8301-e0c6666f1c61 could not be found. Jun 16 16:16:36.658094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:16:36.659191 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f1d5d508-4ee8-490b-a15d-8b1403e776d2 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Returning 404 to user: Instance aa2fe4ab-2e04-4754-8301-e0c6666f1c61 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:16:36.659191 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f1d5d508-4ee8-490b-a15d-8b1403e776d2 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61" status: 404 len: 111 microversion: 2.1 time: 0.029966 Jun 16 16:16:36.659191 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 296/592] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:36 2022] GET /compute/v2.1/servers/aa2fe4ab-2e04-4754-8301-e0c6666f1c61 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:16:36.716788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-faaf8aae-94d2-45be-8459-92051effeb23 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:36.717609 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-faaf8aae-94d2-45be-8459-92051effeb23 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:36.725925 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-faaf8aae-94d2-45be-8459-92051effeb23 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:36.726495 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-faaf8aae-94d2-45be-8459-92051effeb23 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:36.727466 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-faaf8aae-94d2-45be-8459-92051effeb23 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:36.728010 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-faaf8aae-94d2-45be-8459-92051effeb23 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:36.879338 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-faaf8aae-94d2-45be-8459-92051effeb23 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:36.886899 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-faaf8aae-94d2-45be-8459-92051effeb23 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1566 microversion: 2.1 time: 0.174367 Jun 16 16:16:36.887461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 297/593] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:36 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:36.904655 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f9b7e358-4c74-471e-bae3-d13d7f47ae61 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:36.905149 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f9b7e358-4c74-471e-bae3-d13d7f47ae61 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:36.912811 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f9b7e358-4c74-471e-bae3-d13d7f47ae61 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:36.913620 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f9b7e358-4c74-471e-bae3-d13d7f47ae61 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:36.914449 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f9b7e358-4c74-471e-bae3-d13d7f47ae61 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:36.914886 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f9b7e358-4c74-471e-bae3-d13d7f47ae61 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:36.918354 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-401753b0-3fdf-43d8-8005-08098f6222aa tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:36.918969 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-401753b0-3fdf-43d8-8005-08098f6222aa tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:36.925174 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-401753b0-3fdf-43d8-8005-08098f6222aa tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:36.925609 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-401753b0-3fdf-43d8-8005-08098f6222aa tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:36.926403 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-401753b0-3fdf-43d8-8005-08098f6222aa tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:36.926838 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-401753b0-3fdf-43d8-8005-08098f6222aa tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:37.028417 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f9b7e358-4c74-471e-bae3-d13d7f47ae61 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.127679 Jun 16 16:16:37.030132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 297/594] 10.222.0.88 () {58 vars in 1274 bytes} [Thu Jun 16 16:16:36 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:37.093932 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-401753b0-3fdf-43d8-8005-08098f6222aa tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:37.103735 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-401753b0-3fdf-43d8-8005-08098f6222aa tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.189114 Jun 16 16:16:37.104427 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 298/595] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:36 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:37.194656 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-9fc0dd5a-3540-4f34-a314-71ce6e8a1261 req-7a491a34-0458-42db-b2bf-b05191149858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487bea5d-3ad7-4404-9b92-e6b60bc9cf2d", "name": "network-vif-plugged", "status": "completed", "tag": "fad2c47a-ebb1-49bb-9bf9-18b302cdf9ab"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:37.204749 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-9fc0dd5a-3540-4f34-a314-71ce6e8a1261 req-7a491a34-0458-42db-b2bf-b05191149858 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:37.205192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-9fc0dd5a-3540-4f34-a314-71ce6e8a1261 req-7a491a34-0458-42db-b2bf-b05191149858 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:37.217263 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-9fc0dd5a-3540-4f34-a314-71ce6e8a1261 req-7a491a34-0458-42db-b2bf-b05191149858 service nova] Creating event network-vif-plugged:fad2c47a-ebb1-49bb-9bf9-18b302cdf9ab for instance 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d on hv-cinder-83735 Jun 16 16:16:37.222147 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-9fc0dd5a-3540-4f34-a314-71ce6e8a1261 req-7a491a34-0458-42db-b2bf-b05191149858 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031447 Jun 16 16:16:37.223319 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 298/596] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:37.963976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-12ee14d4-eb36-4d8c-99d4-3b6c2e5fdcdc req-e0bf9c88-a1f8-44bf-9e18-2e1a1c75e7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bac54eb-7ea8-4c97-a1f1-7c1da22baccd", "tag": "620a39ba-f7e2-4ae1-acf0-e87136dc559c"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:37.973222 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-12ee14d4-eb36-4d8c-99d4-3b6c2e5fdcdc req-e0bf9c88-a1f8-44bf-9e18-2e1a1c75e7f8 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:37.973666 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-12ee14d4-eb36-4d8c-99d4-3b6c2e5fdcdc req-e0bf9c88-a1f8-44bf-9e18-2e1a1c75e7f8 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:37.986027 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-12ee14d4-eb36-4d8c-99d4-3b6c2e5fdcdc req-e0bf9c88-a1f8-44bf-9e18-2e1a1c75e7f8 service nova] Creating event network-changed:620a39ba-f7e2-4ae1-acf0-e87136dc559c for instance 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd on hv-cinder-83735 Jun 16 16:16:37.991891 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-12ee14d4-eb36-4d8c-99d4-3b6c2e5fdcdc req-e0bf9c88-a1f8-44bf-9e18-2e1a1c75e7f8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031562 Jun 16 16:16:37.992492 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 299/597] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:38.122421 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ab108278-8ed4-414b-9740-5c405ceac9a0 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:38.123030 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ab108278-8ed4-414b-9740-5c405ceac9a0 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:38.129329 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ab108278-8ed4-414b-9740-5c405ceac9a0 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:38.129812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ab108278-8ed4-414b-9740-5c405ceac9a0 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:38.130657 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ab108278-8ed4-414b-9740-5c405ceac9a0 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:38.131102 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ab108278-8ed4-414b-9740-5c405ceac9a0 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:38.268854 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ab108278-8ed4-414b-9740-5c405ceac9a0 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:38.277071 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ab108278-8ed4-414b-9740-5c405ceac9a0 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.159621 Jun 16 16:16:38.277645 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 299/598] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:38 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:39.296051 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-26bf8df1-e156-46f6-94ca-2382fbbdc67a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:39.296745 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-26bf8df1-e156-46f6-94ca-2382fbbdc67a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:39.303655 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-26bf8df1-e156-46f6-94ca-2382fbbdc67a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:39.304098 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-26bf8df1-e156-46f6-94ca-2382fbbdc67a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:39.304857 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-26bf8df1-e156-46f6-94ca-2382fbbdc67a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:39.305292 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-26bf8df1-e156-46f6-94ca-2382fbbdc67a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:39.440836 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-26bf8df1-e156-46f6-94ca-2382fbbdc67a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:39.448374 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-26bf8df1-e156-46f6-94ca-2382fbbdc67a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.157001 Jun 16 16:16:39.448944 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 300/599] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:39 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:40.464973 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-482db87a-01b4-46c3-b45d-d4ddf38cf889 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:40.465570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-482db87a-01b4-46c3-b45d-d4ddf38cf889 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:40.472331 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-482db87a-01b4-46c3-b45d-d4ddf38cf889 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:40.473031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-482db87a-01b4-46c3-b45d-d4ddf38cf889 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:40.473822 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-482db87a-01b4-46c3-b45d-d4ddf38cf889 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:40.474258 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-482db87a-01b4-46c3-b45d-d4ddf38cf889 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:40.608079 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-482db87a-01b4-46c3-b45d-d4ddf38cf889 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:40.615537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-482db87a-01b4-46c3-b45d-d4ddf38cf889 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.154484 Jun 16 16:16:40.616097 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 300/600] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:40 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:41.632861 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d83aaa23-1197-4fc1-89b4-f1ad77b0056c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:41.633451 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d83aaa23-1197-4fc1-89b4-f1ad77b0056c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:41.639950 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d83aaa23-1197-4fc1-89b4-f1ad77b0056c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:41.640399 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d83aaa23-1197-4fc1-89b4-f1ad77b0056c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:41.641152 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d83aaa23-1197-4fc1-89b4-f1ad77b0056c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:41.641585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d83aaa23-1197-4fc1-89b4-f1ad77b0056c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:41.770252 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d83aaa23-1197-4fc1-89b4-f1ad77b0056c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:41.774736 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=100 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:41.779738 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d83aaa23-1197-4fc1-89b4-f1ad77b0056c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.151295 Jun 16 16:16:41.780740 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 301/601] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:41 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:42.796907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-55a1c25f-451e-456d-9470-b61927992e96 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:42.797509 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-55a1c25f-451e-456d-9470-b61927992e96 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:42.800393 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=64 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:42.807055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55a1c25f-451e-456d-9470-b61927992e96 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:42.807501 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55a1c25f-451e-456d-9470-b61927992e96 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:42.808262 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55a1c25f-451e-456d-9470-b61927992e96 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:42.808696 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-55a1c25f-451e-456d-9470-b61927992e96 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:42.941999 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-55a1c25f-451e-456d-9470-b61927992e96 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:42.950802 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-55a1c25f-451e-456d-9470-b61927992e96 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.157966 Jun 16 16:16:42.951389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 301/602] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:42 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:43.967997 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-48dc1af6-5f7b-4253-b253-35b8a11354cd tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:43.968634 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-48dc1af6-5f7b-4253-b253-35b8a11354cd tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:43.976134 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-48dc1af6-5f7b-4253-b253-35b8a11354cd tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:43.976585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-48dc1af6-5f7b-4253-b253-35b8a11354cd tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:43.977343 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-48dc1af6-5f7b-4253-b253-35b8a11354cd tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:43.977803 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-48dc1af6-5f7b-4253-b253-35b8a11354cd tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:44.114990 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-48dc1af6-5f7b-4253-b253-35b8a11354cd tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:44.122355 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-48dc1af6-5f7b-4253-b253-35b8a11354cd tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.158254 Jun 16 16:16:44.122919 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 302/603] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:43 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:45.141241 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-99638d90-461c-41cb-9758-f33c4863bd8b tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:45.142513 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-99638d90-461c-41cb-9758-f33c4863bd8b tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:45.150540 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-99638d90-461c-41cb-9758-f33c4863bd8b tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:45.150998 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-99638d90-461c-41cb-9758-f33c4863bd8b tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:45.152014 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-99638d90-461c-41cb-9758-f33c4863bd8b tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:45.152214 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-99638d90-461c-41cb-9758-f33c4863bd8b tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:45.283644 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-99638d90-461c-41cb-9758-f33c4863bd8b tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:45.291572 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-99638d90-461c-41cb-9758-f33c4863bd8b tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.154893 Jun 16 16:16:45.292132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 302/604] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:45 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:46.308780 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ebabc748-0de7-409f-9291-d24866023de3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:46.309394 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ebabc748-0de7-409f-9291-d24866023de3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:46.316205 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ebabc748-0de7-409f-9291-d24866023de3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:46.316658 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ebabc748-0de7-409f-9291-d24866023de3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:46.317971 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ebabc748-0de7-409f-9291-d24866023de3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:46.318411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ebabc748-0de7-409f-9291-d24866023de3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:46.452678 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ebabc748-0de7-409f-9291-d24866023de3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:46.460970 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ebabc748-0de7-409f-9291-d24866023de3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.156004 Jun 16 16:16:46.461539 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 303/605] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:46 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:47.405543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-92f15de4-3b4b-4a45-a9e1-7c3ba9c6c399 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:47.406099 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-92f15de4-3b4b-4a45-a9e1-7c3ba9c6c399 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:47.413187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-92f15de4-3b4b-4a45-a9e1-7c3ba9c6c399 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:47.413635 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-92f15de4-3b4b-4a45-a9e1-7c3ba9c6c399 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:47.414427 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-92f15de4-3b4b-4a45-a9e1-7c3ba9c6c399 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:47.414861 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-92f15de4-3b4b-4a45-a9e1-7c3ba9c6c399 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:47.437826 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-92f15de4-3b4b-4a45-a9e1-7c3ba9c6c399 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970/ips" status: 200 len: 152 microversion: 2.20 time: 0.036262 Jun 16 16:16:47.438401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 303/606] 10.222.0.88 () {60 vars in 1288 bytes} [Thu Jun 16 16:16:47 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:16:47.477868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-15d227dd-c2a9-46e7-a13b-88dd5bfaf3c7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:47.478421 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-15d227dd-c2a9-46e7-a13b-88dd5bfaf3c7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:47.485326 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-15d227dd-c2a9-46e7-a13b-88dd5bfaf3c7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:47.485700 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-15d227dd-c2a9-46e7-a13b-88dd5bfaf3c7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:47.486451 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-15d227dd-c2a9-46e7-a13b-88dd5bfaf3c7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:47.486892 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-15d227dd-c2a9-46e7-a13b-88dd5bfaf3c7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:47.624414 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-15d227dd-c2a9-46e7-a13b-88dd5bfaf3c7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:47.632824 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-15d227dd-c2a9-46e7-a13b-88dd5bfaf3c7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1358 microversion: 2.1 time: 0.159331 Jun 16 16:16:47.633399 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 304/607] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:47 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:48.651547 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3a6a49ca-d951-4648-97fe-8cd9f634280e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:48.652211 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3a6a49ca-d951-4648-97fe-8cd9f634280e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:48.659181 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3a6a49ca-d951-4648-97fe-8cd9f634280e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:48.659742 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3a6a49ca-d951-4648-97fe-8cd9f634280e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:48.660511 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3a6a49ca-d951-4648-97fe-8cd9f634280e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:48.660949 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3a6a49ca-d951-4648-97fe-8cd9f634280e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:48.801863 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3a6a49ca-d951-4648-97fe-8cd9f634280e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:48.810357 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3a6a49ca-d951-4648-97fe-8cd9f634280e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1549 microversion: 2.1 time: 0.163824 Jun 16 16:16:48.810941 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 304/608] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:48 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:48.827925 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cd20995e-327d-46c6-b2bb-7cc4b6133650 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:48.828631 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-cd20995e-327d-46c6-b2bb-7cc4b6133650 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:48.835909 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cd20995e-327d-46c6-b2bb-7cc4b6133650 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:48.836361 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cd20995e-327d-46c6-b2bb-7cc4b6133650 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:48.837113 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cd20995e-327d-46c6-b2bb-7cc4b6133650 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:48.837547 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cd20995e-327d-46c6-b2bb-7cc4b6133650 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:48.965404 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cd20995e-327d-46c6-b2bb-7cc4b6133650 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:48.974866 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cd20995e-327d-46c6-b2bb-7cc4b6133650 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1549 microversion: 2.1 time: 0.150860 Jun 16 16:16:48.975432 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 305/609] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:48 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:48.990718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-54872dce-300f-41d4-9bb3-cd6d1a14949f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:48.994112 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-54872dce-300f-41d4-9bb3-cd6d1a14949f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:48.994946 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-54872dce-300f-41d4-9bb3-cd6d1a14949f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Searching by: {'deleted': False, 'project_id': '731df982fd964de6bc4545103f7e1047'} {{(pid=117712) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 16:16:49.001628 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-54872dce-300f-41d4-9bb3-cd6d1a14949f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:49.002102 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-54872dce-300f-41d4-9bb3-cd6d1a14949f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:49.002946 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-54872dce-300f-41d4-9bb3-cd6d1a14949f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:49.003314 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-54872dce-300f-41d4-9bb3-cd6d1a14949f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:49.093946 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.multi_cell_list [None req-54872dce-300f-41d4-9bb3-cd6d1a14949f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117712) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 16:16:49.193314 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-54872dce-300f-41d4-9bb3-cd6d1a14949f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.206447 Jun 16 16:16:49.193936 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 305/610] 10.222.0.88 () {58 vars in 1124 bytes} [Thu Jun 16 16:16:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:49.204828 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-075c37ab-29ab-4568-a52f-0d93329bc004 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:49.205556 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-075c37ab-29ab-4568-a52f-0d93329bc004 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:49.214552 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-075c37ab-29ab-4568-a52f-0d93329bc004 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:49.215071 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-075c37ab-29ab-4568-a52f-0d93329bc004 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:49.215825 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-075c37ab-29ab-4568-a52f-0d93329bc004 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:49.216257 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-075c37ab-29ab-4568-a52f-0d93329bc004 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:49.346715 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-075c37ab-29ab-4568-a52f-0d93329bc004 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:49.354926 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-075c37ab-29ab-4568-a52f-0d93329bc004 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1549 microversion: 2.1 time: 0.154587 Jun 16 16:16:49.355504 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 306/611] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:49 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:49.690883 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e2ef9d8a-8884-46f5-a8e2-bd9c76e9ff0e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1163204636", "imageRef": "d2716dc1-3d4d-4f62-b0af-c38986f2a3aa", "flavorRef": "452", "networks": [{"uuid": "3a8a4182-9bbd-4e72-b4bc-641fd3edab1a"}]}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:49.744894 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-e2ef9d8a-8884-46f5-a8e2-bd9c76e9ff0e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] validate_networks() for [('3a8a4182-9bbd-4e72-b4bc-641fd3edab1a', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:16:50.092957 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-e2ef9d8a-8884-46f5-a8e2-bd9c76e9ff0e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:16:50.093416 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-e2ef9d8a-8884-46f5-a8e2-bd9c76e9ff0e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:16:50.093955 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-e2ef9d8a-8884-46f5-a8e2-bd9c76e9ff0e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:16:50.094292 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-e2ef9d8a-8884-46f5-a8e2-bd9c76e9ff0e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:16:50.094750 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-e2ef9d8a-8884-46f5-a8e2-bd9c76e9ff0e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:16:50.104244 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e2ef9d8a-8884-46f5-a8e2-bd9c76e9ff0e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:50.104692 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e2ef9d8a-8884-46f5-a8e2-bd9c76e9ff0e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:50.105486 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e2ef9d8a-8884-46f5-a8e2-bd9c76e9ff0e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:50.105963 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e2ef9d8a-8884-46f5-a8e2-bd9c76e9ff0e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:50.122892 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-e2ef9d8a-8884-46f5-a8e2-bd9c76e9ff0e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Getting quotas for project f5e363bcf5ed47529b6464cf954a31ea. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:16:50.126837 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-e2ef9d8a-8884-46f5-a8e2-bd9c76e9ff0e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Getting quotas for user 1a98ea9b90174a24b57b3875e9df2ecd and project f5e363bcf5ed47529b6464cf954a31ea. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:16:50.138547 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e2ef9d8a-8884-46f5-a8e2-bd9c76e9ff0e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:16:50.141071 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e2ef9d8a-8884-46f5-a8e2-bd9c76e9ff0e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2716dc1-3d4d-4f62-b0af-c38986f2a3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:16:50.190209 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e2ef9d8a-8884-46f5-a8e2-bd9c76e9ff0e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503206 Jun 16 16:16:50.193521 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 306/612] 10.222.0.88 () {60 vars in 1146 bytes} [Thu Jun 16 16:16:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 16:16:50.200945 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b8f9c801-f133-4e36-bd4c-14710d3b695a tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:50.201644 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b8f9c801-f133-4e36-bd4c-14710d3b695a tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:50.261565 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b8f9c801-f133-4e36-bd4c-14710d3b695a tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:50.269863 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b8f9c801-f133-4e36-bd4c-14710d3b695a tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1219 microversion: 2.1 time: 0.072670 Jun 16 16:16:50.270979 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 307/613] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:50 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:50.827173 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4fffdde0-e20f-4178-840a-998d415e9cb8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:50.827723 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4fffdde0-e20f-4178-840a-998d415e9cb8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:50.837665 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4fffdde0-e20f-4178-840a-998d415e9cb8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:50.838139 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4fffdde0-e20f-4178-840a-998d415e9cb8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:50.838903 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4fffdde0-e20f-4178-840a-998d415e9cb8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:50.839332 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4fffdde0-e20f-4178-840a-998d415e9cb8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:50.862967 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-4fffdde0-e20f-4178-840a-998d415e9cb8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lazy-loading 'flavor' on Instance uuid 31998833-f554-4e9e-8215-6694a9d01970 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:16:51.135292 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4fffdde0-e20f-4178-840a-998d415e9cb8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "POST /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970/action" status: 202 len: 0 microversion: 2.20 time: 0.312428 Jun 16 16:16:51.139407 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 307/614] 10.222.0.88 () {62 vars in 1318 bytes} [Thu Jun 16 16:16:50 2022] POST /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:16:51.144665 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3228625b-df1f-45b7-b916-78ed2e05db31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:51.145926 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3228625b-df1f-45b7-b916-78ed2e05db31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:51.152797 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3228625b-df1f-45b7-b916-78ed2e05db31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:51.153241 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3228625b-df1f-45b7-b916-78ed2e05db31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:51.154026 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3228625b-df1f-45b7-b916-78ed2e05db31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:51.154457 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3228625b-df1f-45b7-b916-78ed2e05db31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:51.283046 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3228625b-df1f-45b7-b916-78ed2e05db31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:51.289202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2b04caa7-0d47-47fa-80d3-06ddad6a76a7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:51.290053 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2b04caa7-0d47-47fa-80d3-06ddad6a76a7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:51.291823 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3228625b-df1f-45b7-b916-78ed2e05db31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:51.293384 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3228625b-df1f-45b7-b916-78ed2e05db31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:51.294588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3228625b-df1f-45b7-b916-78ed2e05db31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.154125 Jun 16 16:16:51.295149 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 308/615] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:16:51 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:16:51.297620 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2b04caa7-0d47-47fa-80d3-06ddad6a76a7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:51.298113 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2b04caa7-0d47-47fa-80d3-06ddad6a76a7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:51.298980 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2b04caa7-0d47-47fa-80d3-06ddad6a76a7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:51.299422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2b04caa7-0d47-47fa-80d3-06ddad6a76a7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:51.363713 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2b04caa7-0d47-47fa-80d3-06ddad6a76a7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:51.371842 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2b04caa7-0d47-47fa-80d3-06ddad6a76a7 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1271 microversion: 2.1 time: 0.087229 Jun 16 16:16:51.372326 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 308/616] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:51 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:51.959976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4cab15c2-3ae2-496a-ad45-771fdef300d9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "611e1049-9ca2-4a3b-9dfa-4ac787f70a15"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:51.961123 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4cab15c2-3ae2-496a-ad45-771fdef300d9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:51.967177 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4cab15c2-3ae2-496a-ad45-771fdef300d9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:51.967623 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4cab15c2-3ae2-496a-ad45-771fdef300d9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:51.968384 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4cab15c2-3ae2-496a-ad45-771fdef300d9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:51.968873 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4cab15c2-3ae2-496a-ad45-771fdef300d9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:52.314649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-dd6c9073-604b-42ec-b607-ac58a57a09cd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:52.316029 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dd6c9073-604b-42ec-b607-ac58a57a09cd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:52.324224 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dd6c9073-604b-42ec-b607-ac58a57a09cd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:52.324929 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dd6c9073-604b-42ec-b607-ac58a57a09cd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:52.325945 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dd6c9073-604b-42ec-b607-ac58a57a09cd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:52.326484 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dd6c9073-604b-42ec-b607-ac58a57a09cd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:52.427137 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4cab15c2-3ae2-496a-ad45-771fdef300d9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "POST /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.470455 Jun 16 16:16:52.432393 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 309/617] 10.222.0.88 () {60 vars in 1322 bytes} [Thu Jun 16 16:16:51 2022] POST /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d/os-volume_attachments => generated 194 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:52.446278 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-13dc26dd-18aa-45f0-9599-623a8e6bb1aa tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:52.451439 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-13dc26dd-18aa-45f0-9599-623a8e6bb1aa tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:52.462050 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-13dc26dd-18aa-45f0-9599-623a8e6bb1aa tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:52.462516 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-13dc26dd-18aa-45f0-9599-623a8e6bb1aa tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:52.463297 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-13dc26dd-18aa-45f0-9599-623a8e6bb1aa tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:52.463778 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-13dc26dd-18aa-45f0-9599-623a8e6bb1aa tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:52.571230 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dd6c9073-604b-42ec-b607-ac58a57a09cd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:52.581172 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dd6c9073-604b-42ec-b607-ac58a57a09cd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:52.582912 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dd6c9073-604b-42ec-b607-ac58a57a09cd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:52.584475 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-dd6c9073-604b-42ec-b607-ac58a57a09cd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.274021 Jun 16 16:16:52.585034 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 309/618] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:16:52 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:16:52.681134 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-13dc26dd-18aa-45f0-9599-623a8e6bb1aa tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:52.688902 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-13dc26dd-18aa-45f0-9599-623a8e6bb1aa tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1319 microversion: 2.1 time: 0.259738 Jun 16 16:16:52.689957 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 310/619] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:52 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:53.225161 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-9a1f032f-b8c2-4889-8153-1208b28c4b47 req-f20bd597-b4f1-4505-89e8-7259d8481e6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6", "tag": "1aa6bca0-6f0e-4eab-a7cd-ea2fd3c6696a"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:16:53.234533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-9a1f032f-b8c2-4889-8153-1208b28c4b47 req-f20bd597-b4f1-4505-89e8-7259d8481e6f service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:53.235076 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-9a1f032f-b8c2-4889-8153-1208b28c4b47 req-f20bd597-b4f1-4505-89e8-7259d8481e6f service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:53.246935 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-9a1f032f-b8c2-4889-8153-1208b28c4b47 req-f20bd597-b4f1-4505-89e8-7259d8481e6f service nova] Creating event network-changed:1aa6bca0-6f0e-4eab-a7cd-ea2fd3c6696a for instance 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 on hv-cinder-83735 Jun 16 16:16:53.251906 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-9a1f032f-b8c2-4889-8153-1208b28c4b47 req-f20bd597-b4f1-4505-89e8-7259d8481e6f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030792 Jun 16 16:16:53.252502 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 310/620] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:16:53.603057 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c6559844-cd28-450b-ac63-af5b15532edd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:53.603663 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c6559844-cd28-450b-ac63-af5b15532edd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:53.610285 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c6559844-cd28-450b-ac63-af5b15532edd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:53.610514 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c6559844-cd28-450b-ac63-af5b15532edd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:53.611269 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c6559844-cd28-450b-ac63-af5b15532edd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:53.611716 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c6559844-cd28-450b-ac63-af5b15532edd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:53.707475 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b3b987f8-359a-430f-a150-71641cbc7c81 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:53.708187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b3b987f8-359a-430f-a150-71641cbc7c81 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:53.714608 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b3b987f8-359a-430f-a150-71641cbc7c81 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:53.715058 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b3b987f8-359a-430f-a150-71641cbc7c81 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:53.715941 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b3b987f8-359a-430f-a150-71641cbc7c81 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:53.716384 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b3b987f8-359a-430f-a150-71641cbc7c81 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:53.848334 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c6559844-cd28-450b-ac63-af5b15532edd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:53.856332 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c6559844-cd28-450b-ac63-af5b15532edd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:53.857993 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c6559844-cd28-450b-ac63-af5b15532edd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:53.858989 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c6559844-cd28-450b-ac63-af5b15532edd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.260430 Jun 16 16:16:53.859947 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 311/621] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:16:53 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:16:53.920792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b3b987f8-359a-430f-a150-71641cbc7c81 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:53.928378 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b3b987f8-359a-430f-a150-71641cbc7c81 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1319 microversion: 2.1 time: 0.225560 Jun 16 16:16:53.928950 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 311/622] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:53 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:54.878492 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6155e7b7-c45c-423a-bc76-3e120639afbf tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:54.879034 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6155e7b7-c45c-423a-bc76-3e120639afbf tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:54.885460 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6155e7b7-c45c-423a-bc76-3e120639afbf tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:54.885945 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6155e7b7-c45c-423a-bc76-3e120639afbf tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:54.886714 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6155e7b7-c45c-423a-bc76-3e120639afbf tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:54.887121 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6155e7b7-c45c-423a-bc76-3e120639afbf tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:54.945150 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-98e4cfc7-67fd-4a69-84d7-d24fce36a33e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:54.946005 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-98e4cfc7-67fd-4a69-84d7-d24fce36a33e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:54.952670 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-98e4cfc7-67fd-4a69-84d7-d24fce36a33e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:54.953119 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-98e4cfc7-67fd-4a69-84d7-d24fce36a33e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:54.953930 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-98e4cfc7-67fd-4a69-84d7-d24fce36a33e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:54.954367 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-98e4cfc7-67fd-4a69-84d7-d24fce36a33e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:54.975238 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:55.063604 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6155e7b7-c45c-423a-bc76-3e120639afbf tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:55.072202 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6155e7b7-c45c-423a-bc76-3e120639afbf tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:55.073786 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6155e7b7-c45c-423a-bc76-3e120639afbf tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:55.075165 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6155e7b7-c45c-423a-bc76-3e120639afbf tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.200853 Jun 16 16:16:55.075810 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 312/623] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:16:54 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:16:55.110188 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-98e4cfc7-67fd-4a69-84d7-d24fce36a33e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:55.118307 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-98e4cfc7-67fd-4a69-84d7-d24fce36a33e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1319 microversion: 2.1 time: 0.177135 Jun 16 16:16:55.118865 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 312/624] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:54 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:56.094074 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-55b53b71-1de4-4488-90e6-92c055c23880 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:56.094771 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-55b53b71-1de4-4488-90e6-92c055c23880 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:56.101542 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-55b53b71-1de4-4488-90e6-92c055c23880 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:56.101998 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-55b53b71-1de4-4488-90e6-92c055c23880 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:56.102755 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-55b53b71-1de4-4488-90e6-92c055c23880 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:56.103186 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-55b53b71-1de4-4488-90e6-92c055c23880 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:56.138869 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b0cae863-f468-4fa6-8d24-b53d6fecc923 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:56.139376 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b0cae863-f468-4fa6-8d24-b53d6fecc923 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:56.146049 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b0cae863-f468-4fa6-8d24-b53d6fecc923 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:56.146502 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b0cae863-f468-4fa6-8d24-b53d6fecc923 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:56.147281 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b0cae863-f468-4fa6-8d24-b53d6fecc923 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:56.147717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b0cae863-f468-4fa6-8d24-b53d6fecc923 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:56.286792 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-55b53b71-1de4-4488-90e6-92c055c23880 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:56.294702 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-55b53b71-1de4-4488-90e6-92c055c23880 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:56.296211 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-55b53b71-1de4-4488-90e6-92c055c23880 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:56.297617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-55b53b71-1de4-4488-90e6-92c055c23880 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.207433 Jun 16 16:16:56.298210 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 313/625] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:16:56 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:16:56.320436 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b0cae863-f468-4fa6-8d24-b53d6fecc923 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:56.327673 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b0cae863-f468-4fa6-8d24-b53d6fecc923 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1319 microversion: 2.1 time: 0.193051 Jun 16 16:16:56.328239 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 313/626] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:56 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:57.316406 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8f6507ec-99be-4959-a6e4-cb8b4d3846a1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:57.317498 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8f6507ec-99be-4959-a6e4-cb8b4d3846a1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:57.324162 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8f6507ec-99be-4959-a6e4-cb8b4d3846a1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:57.324602 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8f6507ec-99be-4959-a6e4-cb8b4d3846a1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:57.325349 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8f6507ec-99be-4959-a6e4-cb8b4d3846a1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:57.325806 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8f6507ec-99be-4959-a6e4-cb8b4d3846a1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:57.344278 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e97eb219-b77d-41ff-8a8b-ce8c33ed8c28 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:57.344887 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e97eb219-b77d-41ff-8a8b-ce8c33ed8c28 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:57.351641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e97eb219-b77d-41ff-8a8b-ce8c33ed8c28 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:57.352095 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e97eb219-b77d-41ff-8a8b-ce8c33ed8c28 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:57.352864 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e97eb219-b77d-41ff-8a8b-ce8c33ed8c28 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:57.353297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e97eb219-b77d-41ff-8a8b-ce8c33ed8c28 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:57.527934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8f6507ec-99be-4959-a6e4-cb8b4d3846a1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:57.532212 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e97eb219-b77d-41ff-8a8b-ce8c33ed8c28 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:57.537006 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8f6507ec-99be-4959-a6e4-cb8b4d3846a1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:57.538624 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8f6507ec-99be-4959-a6e4-cb8b4d3846a1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:57.539786 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8f6507ec-99be-4959-a6e4-cb8b4d3846a1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.227295 Jun 16 16:16:57.540263 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e97eb219-b77d-41ff-8a8b-ce8c33ed8c28 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1319 microversion: 2.1 time: 0.199790 Jun 16 16:16:57.540362 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 314/627] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:16:57 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:16:57.540893 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 314/628] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:57 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:16:58.557077 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-08c9dab3-4c25-487d-a274-2fc2597903d6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:58.557846 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-08c9dab3-4c25-487d-a274-2fc2597903d6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:58.558925 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-58076c17-5b52-42f1-b182-99d5a3a8752c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:58.559973 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-58076c17-5b52-42f1-b182-99d5a3a8752c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:58.561668 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=64 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:58.566782 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-58076c17-5b52-42f1-b182-99d5a3a8752c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:58.567614 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-08c9dab3-4c25-487d-a274-2fc2597903d6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:58.567816 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-08c9dab3-4c25-487d-a274-2fc2597903d6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:58.567996 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-58076c17-5b52-42f1-b182-99d5a3a8752c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:58.568569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-58076c17-5b52-42f1-b182-99d5a3a8752c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:58.568744 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-08c9dab3-4c25-487d-a274-2fc2597903d6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:58.568995 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-58076c17-5b52-42f1-b182-99d5a3a8752c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:58.569142 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-08c9dab3-4c25-487d-a274-2fc2597903d6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:58.775899 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-08c9dab3-4c25-487d-a274-2fc2597903d6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:58.782932 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-58076c17-5b52-42f1-b182-99d5a3a8752c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:58.783324 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-08c9dab3-4c25-487d-a274-2fc2597903d6 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1319 microversion: 2.1 time: 0.230193 Jun 16 16:16:58.784215 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 315/629] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:58 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:16:58.792465 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-58076c17-5b52-42f1-b182-99d5a3a8752c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:58.794140 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-58076c17-5b52-42f1-b182-99d5a3a8752c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:16:58.795285 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-58076c17-5b52-42f1-b182-99d5a3a8752c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.241086 Jun 16 16:16:58.795865 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 315/630] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:16:58 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:16:59.800526 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ee426d10-d2be-4ac0-9450-93c8f6ca595c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:59.801173 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ee426d10-d2be-4ac0-9450-93c8f6ca595c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:59.807868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ee426d10-d2be-4ac0-9450-93c8f6ca595c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:59.808319 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ee426d10-d2be-4ac0-9450-93c8f6ca595c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:59.809091 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ee426d10-d2be-4ac0-9450-93c8f6ca595c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:59.809525 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ee426d10-d2be-4ac0-9450-93c8f6ca595c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:59.814051 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5eb06647-5cff-4e9c-af55-844880bf5b75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:16:59.814735 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5eb06647-5cff-4e9c-af55-844880bf5b75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:16:59.821942 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5eb06647-5cff-4e9c-af55-844880bf5b75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:59.822398 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5eb06647-5cff-4e9c-af55-844880bf5b75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:16:59.823173 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5eb06647-5cff-4e9c-af55-844880bf5b75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:16:59.823616 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5eb06647-5cff-4e9c-af55-844880bf5b75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:00.012257 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ee426d10-d2be-4ac0-9450-93c8f6ca595c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:00.015385 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5eb06647-5cff-4e9c-af55-844880bf5b75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:00.021902 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ee426d10-d2be-4ac0-9450-93c8f6ca595c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1319 microversion: 2.1 time: 0.225293 Jun 16 16:17:00.022491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 316/631] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:16:59 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:00.023888 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5eb06647-5cff-4e9c-af55-844880bf5b75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:00.025390 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5eb06647-5cff-4e9c-af55-844880bf5b75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:00.026595 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5eb06647-5cff-4e9c-af55-844880bf5b75 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.216365 Jun 16 16:17:00.027134 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 316/632] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:16:59 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:17:01.038680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fa45de80-a9bf-4273-adc8-f6f02e87216e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:01.039335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fa45de80-a9bf-4273-adc8-f6f02e87216e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:01.041131 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:01.041256 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=4 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:01.042136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=6 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:01.046733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ecaa0a71-918d-4549-b085-e8eade591a07 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:01.047594 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ecaa0a71-918d-4549-b085-e8eade591a07 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:01.048344 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fa45de80-a9bf-4273-adc8-f6f02e87216e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:01.048903 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fa45de80-a9bf-4273-adc8-f6f02e87216e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:01.049592 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fa45de80-a9bf-4273-adc8-f6f02e87216e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:01.050108 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fa45de80-a9bf-4273-adc8-f6f02e87216e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:01.056006 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ecaa0a71-918d-4549-b085-e8eade591a07 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:01.056460 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ecaa0a71-918d-4549-b085-e8eade591a07 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:01.057239 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ecaa0a71-918d-4549-b085-e8eade591a07 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:01.057676 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ecaa0a71-918d-4549-b085-e8eade591a07 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:01.249374 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fa45de80-a9bf-4273-adc8-f6f02e87216e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:01.253872 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ecaa0a71-918d-4549-b085-e8eade591a07 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:01.257796 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fa45de80-a9bf-4273-adc8-f6f02e87216e tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1319 microversion: 2.1 time: 0.222943 Jun 16 16:17:01.258375 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 317/633] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:01 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:01.262630 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ecaa0a71-918d-4549-b085-e8eade591a07 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:01.262798 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d5f7c682-8d57-41a4-a907-1692f515e176 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:01.263371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d5f7c682-8d57-41a4-a907-1692f515e176 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:01.264132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ecaa0a71-918d-4549-b085-e8eade591a07 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:01.265575 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ecaa0a71-918d-4549-b085-e8eade591a07 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.225040 Jun 16 16:17:01.266327 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 317/634] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:01 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:01.269367 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d5f7c682-8d57-41a4-a907-1692f515e176 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:01.269911 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d5f7c682-8d57-41a4-a907-1692f515e176 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:01.271212 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d5f7c682-8d57-41a4-a907-1692f515e176 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:01.271646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d5f7c682-8d57-41a4-a907-1692f515e176 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:01.275789 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:01.411126 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d5f7c682-8d57-41a4-a907-1692f515e176 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:01.419223 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d5f7c682-8d57-41a4-a907-1692f515e176 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1595 microversion: 2.1 time: 0.159882 Jun 16 16:17:01.419798 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 318/635] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:01 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1595 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:02.274984 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5e257c79-21a6-4c40-bc70-a10c5517866b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:02.276539 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5e257c79-21a6-4c40-bc70-a10c5517866b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:02.286833 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cb4f8dd2-1e41-405c-a6f0-a71d5e6c1398 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:02.288072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-cb4f8dd2-1e41-405c-a6f0-a71d5e6c1398 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:02.299052 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cb4f8dd2-1e41-405c-a6f0-a71d5e6c1398 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:02.299504 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cb4f8dd2-1e41-405c-a6f0-a71d5e6c1398 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:02.300317 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cb4f8dd2-1e41-405c-a6f0-a71d5e6c1398 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:02.300745 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cb4f8dd2-1e41-405c-a6f0-a71d5e6c1398 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:02.307115 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5e257c79-21a6-4c40-bc70-a10c5517866b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:02.307568 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5e257c79-21a6-4c40-bc70-a10c5517866b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:02.308346 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5e257c79-21a6-4c40-bc70-a10c5517866b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:02.308785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5e257c79-21a6-4c40-bc70-a10c5517866b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:02.525809 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5e257c79-21a6-4c40-bc70-a10c5517866b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:02.533694 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cb4f8dd2-1e41-405c-a6f0-a71d5e6c1398 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:02.534912 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5e257c79-21a6-4c40-bc70-a10c5517866b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1319 microversion: 2.1 time: 0.264244 Jun 16 16:17:02.535793 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 318/636] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:02 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:02.540624 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-9df809ec-577b-4b18-8f53-b656764ab781 req-a3c61aef-be01-4dad-ae08-d16fa047fa1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6", "name": "network-vif-plugged", "status": "completed", "tag": "1aa6bca0-6f0e-4eab-a7cd-ea2fd3c6696a"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:02.549772 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-9df809ec-577b-4b18-8f53-b656764ab781 req-a3c61aef-be01-4dad-ae08-d16fa047fa1f service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:02.550223 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-9df809ec-577b-4b18-8f53-b656764ab781 req-a3c61aef-be01-4dad-ae08-d16fa047fa1f service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:02.554269 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cb4f8dd2-1e41-405c-a6f0-a71d5e6c1398 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:02.559835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cb4f8dd2-1e41-405c-a6f0-a71d5e6c1398 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:02.561530 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cb4f8dd2-1e41-405c-a6f0-a71d5e6c1398 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.281014 Jun 16 16:17:02.562523 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 319/637] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:02 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:02.562661 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-9df809ec-577b-4b18-8f53-b656764ab781 req-a3c61aef-be01-4dad-ae08-d16fa047fa1f service nova] Creating event network-vif-plugged:1aa6bca0-6f0e-4eab-a7cd-ea2fd3c6696a for instance 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 on hv-cinder-83735 Jun 16 16:17:02.568723 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-9df809ec-577b-4b18-8f53-b656764ab781 req-a3c61aef-be01-4dad-ae08-d16fa047fa1f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031497 Jun 16 16:17:02.569575 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 319/638] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:17:03.390346 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-bc17f666-743b-4399-9940-62b1db490153 req-239e1910-b8e3-41be-9e9a-79eea60985a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "487bea5d-3ad7-4404-9b92-e6b60bc9cf2d", "tag": "fad2c47a-ebb1-49bb-9bf9-18b302cdf9ab"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:03.402097 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-bc17f666-743b-4399-9940-62b1db490153 req-239e1910-b8e3-41be-9e9a-79eea60985a8 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:03.402097 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-bc17f666-743b-4399-9940-62b1db490153 req-239e1910-b8e3-41be-9e9a-79eea60985a8 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:03.413962 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-bc17f666-743b-4399-9940-62b1db490153 req-239e1910-b8e3-41be-9e9a-79eea60985a8 service nova] Creating event network-changed:fad2c47a-ebb1-49bb-9bf9-18b302cdf9ab for instance 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d on hv-cinder-83735 Jun 16 16:17:03.419197 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-bc17f666-743b-4399-9940-62b1db490153 req-239e1910-b8e3-41be-9e9a-79eea60985a8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033600 Jun 16 16:17:03.420006 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 320/639] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:17:03.554380 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c1c2c003-8a71-45a6-8643-042140c88115 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:03.555267 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c1c2c003-8a71-45a6-8643-042140c88115 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:03.563294 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c1c2c003-8a71-45a6-8643-042140c88115 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:03.564100 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c1c2c003-8a71-45a6-8643-042140c88115 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:03.564946 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c1c2c003-8a71-45a6-8643-042140c88115 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:03.565487 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c1c2c003-8a71-45a6-8643-042140c88115 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:03.590415 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-18109a29-412c-4ee1-bff3-75873a83e1a5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:03.591735 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-18109a29-412c-4ee1-bff3-75873a83e1a5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:03.604750 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-18109a29-412c-4ee1-bff3-75873a83e1a5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:03.605233 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-18109a29-412c-4ee1-bff3-75873a83e1a5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:03.606375 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-18109a29-412c-4ee1-bff3-75873a83e1a5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:03.607068 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-18109a29-412c-4ee1-bff3-75873a83e1a5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:03.900141 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c1c2c003-8a71-45a6-8643-042140c88115 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:03.908709 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c1c2c003-8a71-45a6-8643-042140c88115 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1319 microversion: 2.1 time: 0.360069 Jun 16 16:17:03.910738 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 320/640] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:03 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:03.923754 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-18109a29-412c-4ee1-bff3-75873a83e1a5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:03.944396 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-18109a29-412c-4ee1-bff3-75873a83e1a5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:03.946278 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-18109a29-412c-4ee1-bff3-75873a83e1a5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:03.947708 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-18109a29-412c-4ee1-bff3-75873a83e1a5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.364075 Jun 16 16:17:03.948350 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 321/641] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:03 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:04.606768 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fa13dd7f-ed70-49f6-9035-de6a7ad58ad1 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1792347776"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:04.607298 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fa13dd7f-ed70-49f6-9035-de6a7ad58ad1 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:04.614157 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fa13dd7f-ed70-49f6-9035-de6a7ad58ad1 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:04.614608 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fa13dd7f-ed70-49f6-9035-de6a7ad58ad1 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:04.615370 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fa13dd7f-ed70-49f6-9035-de6a7ad58ad1 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:04.615800 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fa13dd7f-ed70-49f6-9035-de6a7ad58ad1 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:04.746728 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.network.security_group_api [None req-fa13dd7f-ed70-49f6-9035-de6a7ad58ad1 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Adding security group 74eac6b2-6dfb-4da7-a773-5d20beb6c965 to port fad2c47a-ebb1-49bb-9bf9-18b302cdf9ab Jun 16 16:17:04.926930 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bbdf4144-2e9c-43a8-aaab-e2ce2dfd5cfd tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:04.927548 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-bbdf4144-2e9c-43a8-aaab-e2ce2dfd5cfd tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:04.934121 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bbdf4144-2e9c-43a8-aaab-e2ce2dfd5cfd tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:04.934572 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bbdf4144-2e9c-43a8-aaab-e2ce2dfd5cfd tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:04.935374 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bbdf4144-2e9c-43a8-aaab-e2ce2dfd5cfd tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:04.935810 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bbdf4144-2e9c-43a8-aaab-e2ce2dfd5cfd tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:05.237999 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bbdf4144-2e9c-43a8-aaab-e2ce2dfd5cfd tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:05.246054 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-bbdf4144-2e9c-43a8-aaab-e2ce2dfd5cfd tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1319 microversion: 2.1 time: 0.323474 Jun 16 16:17:05.246629 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 322/642] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:04 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:05.252068 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-689e6872-472b-45d6-9f94-8548fe53ad68 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:05.252897 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-689e6872-472b-45d6-9f94-8548fe53ad68 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:05.259963 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-689e6872-472b-45d6-9f94-8548fe53ad68 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:05.260876 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-689e6872-472b-45d6-9f94-8548fe53ad68 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:05.261656 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-689e6872-472b-45d6-9f94-8548fe53ad68 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:05.262858 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-689e6872-472b-45d6-9f94-8548fe53ad68 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:05.458324 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fa13dd7f-ed70-49f6-9035-de6a7ad58ad1 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "POST /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d/action" status: 202 len: 0 microversion: 2.1 time: 0.855545 Jun 16 16:17:05.459163 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 321/643] 10.222.0.88 () {60 vars in 1277 bytes} [Thu Jun 16 16:17:04 2022] POST /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d/action => generated 0 bytes in 857 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:17:05.469186 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a0b44c53-cb48-4ec8-90fa-c297342ce954 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:05.469929 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a0b44c53-cb48-4ec8-90fa-c297342ce954 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:05.486073 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a0b44c53-cb48-4ec8-90fa-c297342ce954 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:05.486781 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a0b44c53-cb48-4ec8-90fa-c297342ce954 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:05.488118 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a0b44c53-cb48-4ec8-90fa-c297342ce954 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:05.488799 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a0b44c53-cb48-4ec8-90fa-c297342ce954 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:05.499161 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-689e6872-472b-45d6-9f94-8548fe53ad68 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:05.517648 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-689e6872-472b-45d6-9f94-8548fe53ad68 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:05.524657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-689e6872-472b-45d6-9f94-8548fe53ad68 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:05.525930 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-689e6872-472b-45d6-9f94-8548fe53ad68 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.278250 Jun 16 16:17:05.529276 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 323/644] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:05 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:05.539740 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-55cdce76-c0a8-47f5-baa2-ea4126dc7069 req-0646f078-116b-481b-b85e-9dc0e7274c17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "487bea5d-3ad7-4404-9b92-e6b60bc9cf2d", "tag": "fad2c47a-ebb1-49bb-9bf9-18b302cdf9ab"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:05.560042 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-55cdce76-c0a8-47f5-baa2-ea4126dc7069 req-0646f078-116b-481b-b85e-9dc0e7274c17 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:05.561010 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-55cdce76-c0a8-47f5-baa2-ea4126dc7069 req-0646f078-116b-481b-b85e-9dc0e7274c17 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:05.576579 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-55cdce76-c0a8-47f5-baa2-ea4126dc7069 req-0646f078-116b-481b-b85e-9dc0e7274c17 service nova] Creating event network-changed:fad2c47a-ebb1-49bb-9bf9-18b302cdf9ab for instance 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d on hv-cinder-83735 Jun 16 16:17:05.582580 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-55cdce76-c0a8-47f5-baa2-ea4126dc7069 req-0646f078-116b-481b-b85e-9dc0e7274c17 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051756 Jun 16 16:17:05.583631 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 324/645] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:17:05.703535 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a0b44c53-cb48-4ec8-90fa-c297342ce954 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:05.713645 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a0b44c53-cb48-4ec8-90fa-c297342ce954 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1642 microversion: 2.1 time: 0.249827 Jun 16 16:17:05.714537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 322/646] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:05 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1642 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:06.264479 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0de7f42c-d0de-423a-abda-c49e4d42588c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:06.265328 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0de7f42c-d0de-423a-abda-c49e4d42588c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:06.271564 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0de7f42c-d0de-423a-abda-c49e4d42588c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:06.272014 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0de7f42c-d0de-423a-abda-c49e4d42588c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:06.272783 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0de7f42c-d0de-423a-abda-c49e4d42588c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:06.273218 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0de7f42c-d0de-423a-abda-c49e4d42588c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:06.410611 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0de7f42c-d0de-423a-abda-c49e4d42588c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:06.419252 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0de7f42c-d0de-423a-abda-c49e4d42588c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1507 microversion: 2.1 time: 0.159479 Jun 16 16:17:06.419839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 325/647] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:06 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:06.435833 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1cd502e4-c282-409a-83aa-7e5706899b80 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "989fabbe-48e8-40f2-8124-1420f8642466", "device": "/dev/sdb"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:06.437459 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1cd502e4-c282-409a-83aa-7e5706899b80 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:06.444340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1cd502e4-c282-409a-83aa-7e5706899b80 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:06.444788 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1cd502e4-c282-409a-83aa-7e5706899b80 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:06.445555 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1cd502e4-c282-409a-83aa-7e5706899b80 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:06.446022 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1cd502e4-c282-409a-83aa-7e5706899b80 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:06.546851 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4018e21e-2397-46d3-8244-36a9155b6834 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:06.547460 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4018e21e-2397-46d3-8244-36a9155b6834 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:06.554567 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4018e21e-2397-46d3-8244-36a9155b6834 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:06.555010 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4018e21e-2397-46d3-8244-36a9155b6834 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:06.555769 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4018e21e-2397-46d3-8244-36a9155b6834 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:06.556208 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4018e21e-2397-46d3-8244-36a9155b6834 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:06.717003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4018e21e-2397-46d3-8244-36a9155b6834 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:06.725879 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4018e21e-2397-46d3-8244-36a9155b6834 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:06.727394 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4018e21e-2397-46d3-8244-36a9155b6834 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:06.728557 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4018e21e-2397-46d3-8244-36a9155b6834 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.185785 Jun 16 16:17:06.729120 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 326/648] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:06 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:17:07.012742 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1cd502e4-c282-409a-83aa-7e5706899b80 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "POST /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.580658 Jun 16 16:17:07.017801 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 323/649] 10.222.0.88 () {60 vars in 1322 bytes} [Thu Jun 16 16:17:06 2022] POST /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6/os-volume_attachments => generated 194 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:17:07.747161 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-eebe7ed2-1da2-4e0f-afd2-0cd8b8b51f02 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:07.747882 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-eebe7ed2-1da2-4e0f-afd2-0cd8b8b51f02 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:07.755078 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eebe7ed2-1da2-4e0f-afd2-0cd8b8b51f02 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:07.755550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eebe7ed2-1da2-4e0f-afd2-0cd8b8b51f02 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:07.756324 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eebe7ed2-1da2-4e0f-afd2-0cd8b8b51f02 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:07.756756 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eebe7ed2-1da2-4e0f-afd2-0cd8b8b51f02 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:07.892501 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-eebe7ed2-1da2-4e0f-afd2-0cd8b8b51f02 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:07.901058 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-eebe7ed2-1da2-4e0f-afd2-0cd8b8b51f02 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:07.902591 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-eebe7ed2-1da2-4e0f-afd2-0cd8b8b51f02 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:07.903736 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-eebe7ed2-1da2-4e0f-afd2-0cd8b8b51f02 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.160607 Jun 16 16:17:07.904297 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 327/650] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:07 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:17:08.924044 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6cfb8810-b01b-4d1a-acae-71e7ca95a9c6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:08.924781 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6cfb8810-b01b-4d1a-acae-71e7ca95a9c6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:08.932811 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6cfb8810-b01b-4d1a-acae-71e7ca95a9c6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:08.933263 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6cfb8810-b01b-4d1a-acae-71e7ca95a9c6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:08.934067 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6cfb8810-b01b-4d1a-acae-71e7ca95a9c6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:08.934503 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6cfb8810-b01b-4d1a-acae-71e7ca95a9c6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:09.067510 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6cfb8810-b01b-4d1a-acae-71e7ca95a9c6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:09.075330 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6cfb8810-b01b-4d1a-acae-71e7ca95a9c6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:09.076856 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6cfb8810-b01b-4d1a-acae-71e7ca95a9c6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:09.078262 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6cfb8810-b01b-4d1a-acae-71e7ca95a9c6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.158890 Jun 16 16:17:09.078681 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 324/651] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:08 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:10.096656 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1bd84014-27c3-4e4a-a771-28f74c65f969 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:10.097260 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1bd84014-27c3-4e4a-a771-28f74c65f969 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:10.104593 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1bd84014-27c3-4e4a-a771-28f74c65f969 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:10.105038 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1bd84014-27c3-4e4a-a771-28f74c65f969 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:10.105819 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1bd84014-27c3-4e4a-a771-28f74c65f969 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:10.106256 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1bd84014-27c3-4e4a-a771-28f74c65f969 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:10.239605 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1bd84014-27c3-4e4a-a771-28f74c65f969 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:10.247497 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1bd84014-27c3-4e4a-a771-28f74c65f969 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:10.248990 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1bd84014-27c3-4e4a-a771-28f74c65f969 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:10.250220 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1bd84014-27c3-4e4a-a771-28f74c65f969 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.157522 Jun 16 16:17:10.250780 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 328/652] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:10 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:11.268265 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-daec22bb-ca1c-47e7-a7c8-ad9e2e6a31fb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:11.268905 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-daec22bb-ca1c-47e7-a7c8-ad9e2e6a31fb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:11.276063 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-daec22bb-ca1c-47e7-a7c8-ad9e2e6a31fb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:11.276586 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-daec22bb-ca1c-47e7-a7c8-ad9e2e6a31fb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:11.277345 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-daec22bb-ca1c-47e7-a7c8-ad9e2e6a31fb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:11.277795 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-daec22bb-ca1c-47e7-a7c8-ad9e2e6a31fb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:11.410267 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-daec22bb-ca1c-47e7-a7c8-ad9e2e6a31fb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:11.418431 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-daec22bb-ca1c-47e7-a7c8-ad9e2e6a31fb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:11.419939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-daec22bb-ca1c-47e7-a7c8-ad9e2e6a31fb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:11.421084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-daec22bb-ca1c-47e7-a7c8-ad9e2e6a31fb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.156675 Jun 16 16:17:11.421639 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 325/653] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:11 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:12.439685 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a8c2e670-94ae-4a54-a584-1a19f665d81a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:12.440290 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a8c2e670-94ae-4a54-a584-1a19f665d81a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:12.447478 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a8c2e670-94ae-4a54-a584-1a19f665d81a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:12.447863 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a8c2e670-94ae-4a54-a584-1a19f665d81a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:12.448619 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a8c2e670-94ae-4a54-a584-1a19f665d81a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:12.449053 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a8c2e670-94ae-4a54-a584-1a19f665d81a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:12.579868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a8c2e670-94ae-4a54-a584-1a19f665d81a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:12.588461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a8c2e670-94ae-4a54-a584-1a19f665d81a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:12.590006 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a8c2e670-94ae-4a54-a584-1a19f665d81a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:12.591442 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a8c2e670-94ae-4a54-a584-1a19f665d81a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.155669 Jun 16 16:17:12.592012 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 329/654] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:12 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:13.610724 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6012eb47-649c-434c-9963-e2066624b110 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:13.611330 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6012eb47-649c-434c-9963-e2066624b110 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:13.614197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:13.620121 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6012eb47-649c-434c-9963-e2066624b110 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:13.620641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6012eb47-649c-434c-9963-e2066624b110 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:13.621460 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6012eb47-649c-434c-9963-e2066624b110 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:13.621924 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6012eb47-649c-434c-9963-e2066624b110 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:13.766936 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6012eb47-649c-434c-9963-e2066624b110 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:13.775659 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6012eb47-649c-434c-9963-e2066624b110 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:13.777167 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6012eb47-649c-434c-9963-e2066624b110 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:13.778376 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6012eb47-649c-434c-9963-e2066624b110 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.172285 Jun 16 16:17:13.778950 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 326/655] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:13 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:14.796515 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-13252152-2a3e-4914-9ba2-efa0706f6064 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:14.797158 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-13252152-2a3e-4914-9ba2-efa0706f6064 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:14.803987 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-13252152-2a3e-4914-9ba2-efa0706f6064 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:14.804436 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-13252152-2a3e-4914-9ba2-efa0706f6064 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:14.805204 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-13252152-2a3e-4914-9ba2-efa0706f6064 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:14.805643 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-13252152-2a3e-4914-9ba2-efa0706f6064 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:14.951877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-13252152-2a3e-4914-9ba2-efa0706f6064 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:14.962876 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-13252152-2a3e-4914-9ba2-efa0706f6064 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:14.964729 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-13252152-2a3e-4914-9ba2-efa0706f6064 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:14.966347 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-13252152-2a3e-4914-9ba2-efa0706f6064 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1744 microversion: 2.20 time: 0.173386 Jun 16 16:17:14.966802 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 330/656] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:14 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:15.985834 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2c943fe3-ecd7-4941-8126-46bf9b0bb0b6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:15.986432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2c943fe3-ecd7-4941-8126-46bf9b0bb0b6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:15.993036 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2c943fe3-ecd7-4941-8126-46bf9b0bb0b6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:15.993482 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2c943fe3-ecd7-4941-8126-46bf9b0bb0b6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:15.994268 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2c943fe3-ecd7-4941-8126-46bf9b0bb0b6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:15.994695 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2c943fe3-ecd7-4941-8126-46bf9b0bb0b6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:16.129599 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2c943fe3-ecd7-4941-8126-46bf9b0bb0b6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:16.137730 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2c943fe3-ecd7-4941-8126-46bf9b0bb0b6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:16.139232 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2c943fe3-ecd7-4941-8126-46bf9b0bb0b6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:16.140641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2c943fe3-ecd7-4941-8126-46bf9b0bb0b6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1744 microversion: 2.20 time: 0.158566 Jun 16 16:17:16.141295 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 327/657] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:15 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:16.297682 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-0425a0e7-ea39-4e9b-824e-9ff4ff39f1d9 req-cf536ad9-77c4-43fa-980c-600b579548f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31998833-f554-4e9e-8215-6694a9d01970", "name": "network-vif-plugged", "status": "completed", "tag": "45b1ab78-929d-4b1a-90a1-4777fb503a47"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:16.307147 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-0425a0e7-ea39-4e9b-824e-9ff4ff39f1d9 req-cf536ad9-77c4-43fa-980c-600b579548f7 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:16.307587 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-0425a0e7-ea39-4e9b-824e-9ff4ff39f1d9 req-cf536ad9-77c4-43fa-980c-600b579548f7 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:16.319881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-0425a0e7-ea39-4e9b-824e-9ff4ff39f1d9 req-cf536ad9-77c4-43fa-980c-600b579548f7 service nova] Creating event network-vif-plugged:45b1ab78-929d-4b1a-90a1-4777fb503a47 for instance 31998833-f554-4e9e-8215-6694a9d01970 on hv-cinder-83735 Jun 16 16:17:16.325506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-0425a0e7-ea39-4e9b-824e-9ff4ff39f1d9 req-cf536ad9-77c4-43fa-980c-600b579548f7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031540 Jun 16 16:17:16.326137 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 331/658] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:17:17.159313 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-16846b79-2d8e-43bd-bd0a-fc4ad5c4a8cb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:17.159985 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-16846b79-2d8e-43bd-bd0a-fc4ad5c4a8cb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:17.166968 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-16846b79-2d8e-43bd-bd0a-fc4ad5c4a8cb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:17.167418 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-16846b79-2d8e-43bd-bd0a-fc4ad5c4a8cb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:17.168168 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-16846b79-2d8e-43bd-bd0a-fc4ad5c4a8cb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:17.168597 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-16846b79-2d8e-43bd-bd0a-fc4ad5c4a8cb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:17.297882 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-16846b79-2d8e-43bd-bd0a-fc4ad5c4a8cb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:17.301282 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:17.306652 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-16846b79-2d8e-43bd-bd0a-fc4ad5c4a8cb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:17.308140 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-16846b79-2d8e-43bd-bd0a-fc4ad5c4a8cb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:17.309279 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-16846b79-2d8e-43bd-bd0a-fc4ad5c4a8cb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1744 microversion: 2.20 time: 0.153937 Jun 16 16:17:17.309870 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 328/659] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:17 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:18.121112 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-da07bdbc-6fb9-45a5-9d42-11b4bbaa95df tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:18.121670 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-da07bdbc-6fb9-45a5-9d42-11b4bbaa95df tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:18.128464 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-da07bdbc-6fb9-45a5-9d42-11b4bbaa95df tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:18.129644 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-da07bdbc-6fb9-45a5-9d42-11b4bbaa95df tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:18.130390 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-da07bdbc-6fb9-45a5-9d42-11b4bbaa95df tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:18.130817 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-da07bdbc-6fb9-45a5-9d42-11b4bbaa95df tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:18.154039 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-da07bdbc-6fb9-45a5-9d42-11b4bbaa95df tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40/ips" status: 200 len: 149 microversion: 2.1 time: 0.037166 Jun 16 16:17:18.154610 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 332/660] 10.222.0.88 () {58 vars in 1247 bytes} [Thu Jun 16 16:17:18 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:17:18.328321 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0cb4abe6-423a-4699-84ab-2311d2c24b67 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:18.328963 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0cb4abe6-423a-4699-84ab-2311d2c24b67 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:18.336734 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0cb4abe6-423a-4699-84ab-2311d2c24b67 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:18.337223 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0cb4abe6-423a-4699-84ab-2311d2c24b67 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:18.338032 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0cb4abe6-423a-4699-84ab-2311d2c24b67 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:18.338470 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0cb4abe6-423a-4699-84ab-2311d2c24b67 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:18.479961 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0cb4abe6-423a-4699-84ab-2311d2c24b67 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:18.488761 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0cb4abe6-423a-4699-84ab-2311d2c24b67 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:18.490296 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0cb4abe6-423a-4699-84ab-2311d2c24b67 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:18.491459 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0cb4abe6-423a-4699-84ab-2311d2c24b67 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1744 microversion: 2.20 time: 0.167363 Jun 16 16:17:18.492022 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 329/661] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:18 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:19.509500 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4630bb0e-f3cf-4d85-89bc-54219677ac58 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:19.510152 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4630bb0e-f3cf-4d85-89bc-54219677ac58 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:19.516815 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4630bb0e-f3cf-4d85-89bc-54219677ac58 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:19.517270 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4630bb0e-f3cf-4d85-89bc-54219677ac58 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:19.518115 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4630bb0e-f3cf-4d85-89bc-54219677ac58 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:19.518557 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4630bb0e-f3cf-4d85-89bc-54219677ac58 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:19.650597 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4630bb0e-f3cf-4d85-89bc-54219677ac58 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:19.658592 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4630bb0e-f3cf-4d85-89bc-54219677ac58 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:19.660658 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4630bb0e-f3cf-4d85-89bc-54219677ac58 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:19.662161 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4630bb0e-f3cf-4d85-89bc-54219677ac58 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1744 microversion: 2.20 time: 0.156521 Jun 16 16:17:19.662727 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 333/662] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:19 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:20.680367 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-968a8eb7-0e28-472b-84ce-19adb44b8cd2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:20.680952 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-968a8eb7-0e28-472b-84ce-19adb44b8cd2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:20.687400 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-968a8eb7-0e28-472b-84ce-19adb44b8cd2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:20.687843 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-968a8eb7-0e28-472b-84ce-19adb44b8cd2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:20.688596 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-968a8eb7-0e28-472b-84ce-19adb44b8cd2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:20.689038 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-968a8eb7-0e28-472b-84ce-19adb44b8cd2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:20.819701 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-968a8eb7-0e28-472b-84ce-19adb44b8cd2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:20.827982 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-968a8eb7-0e28-472b-84ce-19adb44b8cd2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:20.829477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-968a8eb7-0e28-472b-84ce-19adb44b8cd2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:20.830640 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-968a8eb7-0e28-472b-84ce-19adb44b8cd2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1744 microversion: 2.20 time: 0.154227 Jun 16 16:17:20.831195 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 330/663] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:20 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:21.849325 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e7cc0d51-9b03-4207-845f-6f5cfbff531c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:21.849956 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e7cc0d51-9b03-4207-845f-6f5cfbff531c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:21.857112 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e7cc0d51-9b03-4207-845f-6f5cfbff531c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:21.857567 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e7cc0d51-9b03-4207-845f-6f5cfbff531c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:21.858380 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e7cc0d51-9b03-4207-845f-6f5cfbff531c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:21.858841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e7cc0d51-9b03-4207-845f-6f5cfbff531c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:21.992708 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e7cc0d51-9b03-4207-845f-6f5cfbff531c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:22.000652 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e7cc0d51-9b03-4207-845f-6f5cfbff531c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:22.002330 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e7cc0d51-9b03-4207-845f-6f5cfbff531c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:22.003963 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e7cc0d51-9b03-4207-845f-6f5cfbff531c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1744 microversion: 2.20 time: 0.158329 Jun 16 16:17:22.004756 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 334/664] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:21 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:23.023199 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9573c113-cc5c-40a8-b3dd-4607bbcb7bd4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:23.023836 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9573c113-cc5c-40a8-b3dd-4607bbcb7bd4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:23.030476 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9573c113-cc5c-40a8-b3dd-4607bbcb7bd4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:23.030923 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9573c113-cc5c-40a8-b3dd-4607bbcb7bd4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:23.031687 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9573c113-cc5c-40a8-b3dd-4607bbcb7bd4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:23.032122 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9573c113-cc5c-40a8-b3dd-4607bbcb7bd4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:23.162604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9573c113-cc5c-40a8-b3dd-4607bbcb7bd4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:23.170534 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9573c113-cc5c-40a8-b3dd-4607bbcb7bd4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:23.172377 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9573c113-cc5c-40a8-b3dd-4607bbcb7bd4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:23.173540 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9573c113-cc5c-40a8-b3dd-4607bbcb7bd4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1744 microversion: 2.20 time: 0.154883 Jun 16 16:17:23.174144 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 331/665] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:23 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:24.193183 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9d93e794-2f24-4c87-8fca-d6ab12b849ae tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:24.193766 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9d93e794-2f24-4c87-8fca-d6ab12b849ae tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:24.200215 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d93e794-2f24-4c87-8fca-d6ab12b849ae tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:24.200658 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d93e794-2f24-4c87-8fca-d6ab12b849ae tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:24.201405 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d93e794-2f24-4c87-8fca-d6ab12b849ae tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:24.201876 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d93e794-2f24-4c87-8fca-d6ab12b849ae tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:24.447586 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9d93e794-2f24-4c87-8fca-d6ab12b849ae tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:24.455850 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9d93e794-2f24-4c87-8fca-d6ab12b849ae tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:24.457964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9d93e794-2f24-4c87-8fca-d6ab12b849ae tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:24.459126 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9d93e794-2f24-4c87-8fca-d6ab12b849ae tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1744 microversion: 2.20 time: 0.270017 Jun 16 16:17:24.459687 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 335/666] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:24 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1744 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:25.477848 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b6f43895-215d-4d8d-8574-857ca11661ae tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:25.478469 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b6f43895-215d-4d8d-8574-857ca11661ae tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:25.485022 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b6f43895-215d-4d8d-8574-857ca11661ae tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:25.485463 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b6f43895-215d-4d8d-8574-857ca11661ae tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:25.486243 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b6f43895-215d-4d8d-8574-857ca11661ae tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:25.486677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b6f43895-215d-4d8d-8574-857ca11661ae tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:25.616703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b6f43895-215d-4d8d-8574-857ca11661ae tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:25.624564 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b6f43895-215d-4d8d-8574-857ca11661ae tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:25.626100 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b6f43895-215d-4d8d-8574-857ca11661ae tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:25.627260 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b6f43895-215d-4d8d-8574-857ca11661ae tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1744 microversion: 2.20 time: 0.153287 Jun 16 16:17:25.627826 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 332/667] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:25 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:26.645993 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0922bc33-183c-4585-a328-d99e5b248b9b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:26.646654 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0922bc33-183c-4585-a328-d99e5b248b9b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:26.653062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0922bc33-183c-4585-a328-d99e5b248b9b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:26.653507 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0922bc33-183c-4585-a328-d99e5b248b9b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:26.654298 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0922bc33-183c-4585-a328-d99e5b248b9b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:26.654730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0922bc33-183c-4585-a328-d99e5b248b9b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:26.782322 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0922bc33-183c-4585-a328-d99e5b248b9b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:26.791051 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0922bc33-183c-4585-a328-d99e5b248b9b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:26.792498 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0922bc33-183c-4585-a328-d99e5b248b9b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:26.793664 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0922bc33-183c-4585-a328-d99e5b248b9b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1744 microversion: 2.20 time: 0.151831 Jun 16 16:17:26.794242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 336/668] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:26 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:27.812878 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b6337454-14d7-48b3-b07a-2c2e9e7251f6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:27.813462 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b6337454-14d7-48b3-b07a-2c2e9e7251f6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:27.820580 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b6337454-14d7-48b3-b07a-2c2e9e7251f6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:27.821100 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b6337454-14d7-48b3-b07a-2c2e9e7251f6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:27.821898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b6337454-14d7-48b3-b07a-2c2e9e7251f6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:27.822326 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b6337454-14d7-48b3-b07a-2c2e9e7251f6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:27.896097 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fbe28fd0-4b0b-4c4d-837a-5157c1110d54 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f6d88ca-c4b2-4ac7-a03f-179aee37c78d"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:27.898110 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fbe28fd0-4b0b-4c4d-837a-5157c1110d54 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:27.905410 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fbe28fd0-4b0b-4c4d-837a-5157c1110d54 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:27.906058 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fbe28fd0-4b0b-4c4d-837a-5157c1110d54 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:27.907043 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fbe28fd0-4b0b-4c4d-837a-5157c1110d54 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:27.907539 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fbe28fd0-4b0b-4c4d-837a-5157c1110d54 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:27.912212 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=100 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:28.011105 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b6337454-14d7-48b3-b07a-2c2e9e7251f6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:28.019394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b6337454-14d7-48b3-b07a-2c2e9e7251f6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:28.021234 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b6337454-14d7-48b3-b07a-2c2e9e7251f6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:28.022562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b6337454-14d7-48b3-b07a-2c2e9e7251f6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1744 microversion: 2.20 time: 0.213517 Jun 16 16:17:28.023190 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 333/669] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:27 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1744 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:29.041698 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-787aae75-7717-484b-8cba-81ff06e86c65 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:29.043094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-787aae75-7717-484b-8cba-81ff06e86c65 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:29.049111 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-787aae75-7717-484b-8cba-81ff06e86c65 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:29.049563 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-787aae75-7717-484b-8cba-81ff06e86c65 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:29.050952 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-787aae75-7717-484b-8cba-81ff06e86c65 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:29.051396 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-787aae75-7717-484b-8cba-81ff06e86c65 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:29.184538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-787aae75-7717-484b-8cba-81ff06e86c65 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:29.192621 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-787aae75-7717-484b-8cba-81ff06e86c65 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:29.194129 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-787aae75-7717-484b-8cba-81ff06e86c65 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:29.195324 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-787aae75-7717-484b-8cba-81ff06e86c65 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1744 microversion: 2.20 time: 0.157546 Jun 16 16:17:29.195877 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 334/670] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:29 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:17:30.213544 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9e694a14-0941-4979-bf5e-d473a2437eab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:30.214241 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9e694a14-0941-4979-bf5e-d473a2437eab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:30.220658 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9e694a14-0941-4979-bf5e-d473a2437eab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:30.221107 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9e694a14-0941-4979-bf5e-d473a2437eab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:30.221902 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9e694a14-0941-4979-bf5e-d473a2437eab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:30.223154 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9e694a14-0941-4979-bf5e-d473a2437eab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:30.355266 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9e694a14-0941-4979-bf5e-d473a2437eab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:30.363291 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9e694a14-0941-4979-bf5e-d473a2437eab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:30.364790 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9e694a14-0941-4979-bf5e-d473a2437eab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:30.365968 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9e694a14-0941-4979-bf5e-d473a2437eab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1744 microversion: 2.20 time: 0.156295 Jun 16 16:17:30.366529 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 335/671] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:30 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:17:31.384433 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cc891597-3bdb-4132-bf17-281ba37b1a88 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:31.385138 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-cc891597-3bdb-4132-bf17-281ba37b1a88 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:31.391778 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cc891597-3bdb-4132-bf17-281ba37b1a88 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:31.392181 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cc891597-3bdb-4132-bf17-281ba37b1a88 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:31.392979 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cc891597-3bdb-4132-bf17-281ba37b1a88 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:31.393406 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cc891597-3bdb-4132-bf17-281ba37b1a88 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:31.526134 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cc891597-3bdb-4132-bf17-281ba37b1a88 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:31.534095 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cc891597-3bdb-4132-bf17-281ba37b1a88 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:31.536273 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cc891597-3bdb-4132-bf17-281ba37b1a88 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:31.537446 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-cc891597-3bdb-4132-bf17-281ba37b1a88 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1744 microversion: 2.20 time: 0.157169 Jun 16 16:17:31.538031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 336/672] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:31 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:17:32.361669 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fbe28fd0-4b0b-4c4d-837a-5157c1110d54 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "POST /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.469316 Jun 16 16:17:32.362297 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 337/673] 10.222.0.88 () {60 vars in 1322 bytes} [Thu Jun 16 16:17:27 2022] POST /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40/os-volume_attachments => generated 194 bytes in 4471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:17:32.556333 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-96d5d60f-4295-4595-bfe7-e2491f7654b2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:32.556966 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-96d5d60f-4295-4595-bfe7-e2491f7654b2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:32.563415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-96d5d60f-4295-4595-bfe7-e2491f7654b2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:32.563857 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-96d5d60f-4295-4595-bfe7-e2491f7654b2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:32.564617 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-96d5d60f-4295-4595-bfe7-e2491f7654b2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:32.565044 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-96d5d60f-4295-4595-bfe7-e2491f7654b2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:32.699427 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-96d5d60f-4295-4595-bfe7-e2491f7654b2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:32.707693 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-96d5d60f-4295-4595-bfe7-e2491f7654b2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:32.709220 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-96d5d60f-4295-4595-bfe7-e2491f7654b2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:32.710423 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-96d5d60f-4295-4595-bfe7-e2491f7654b2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1744 microversion: 2.20 time: 0.157975 Jun 16 16:17:32.710992 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 337/674] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:32 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:33.730299 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ec463d93-3f6c-4cec-a01f-12e820919e68 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:33.731028 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ec463d93-3f6c-4cec-a01f-12e820919e68 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:33.732907 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=46 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:33.738728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ec463d93-3f6c-4cec-a01f-12e820919e68 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:33.739160 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ec463d93-3f6c-4cec-a01f-12e820919e68 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:33.739949 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ec463d93-3f6c-4cec-a01f-12e820919e68 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:33.740508 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ec463d93-3f6c-4cec-a01f-12e820919e68 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:34.095789 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ec463d93-3f6c-4cec-a01f-12e820919e68 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:34.104470 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ec463d93-3f6c-4cec-a01f-12e820919e68 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:34.108563 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ec463d93-3f6c-4cec-a01f-12e820919e68 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:34.109990 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ec463d93-3f6c-4cec-a01f-12e820919e68 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1739 microversion: 2.20 time: 0.384508 Jun 16 16:17:34.110967 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 338/675] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:33 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1739 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:35.152331 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-61cb0622-57dc-4576-aace-f8d2d25d7804 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:35.156837 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-61cb0622-57dc-4576-aace-f8d2d25d7804 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:35.169557 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61cb0622-57dc-4576-aace-f8d2d25d7804 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:35.170051 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61cb0622-57dc-4576-aace-f8d2d25d7804 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:35.170893 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61cb0622-57dc-4576-aace-f8d2d25d7804 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:35.171583 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61cb0622-57dc-4576-aace-f8d2d25d7804 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:35.330600 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-61cb0622-57dc-4576-aace-f8d2d25d7804 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:35.340813 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-61cb0622-57dc-4576-aace-f8d2d25d7804 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:35.342728 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-61cb0622-57dc-4576-aace-f8d2d25d7804 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:35.343911 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-61cb0622-57dc-4576-aace-f8d2d25d7804 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1739 microversion: 2.20 time: 0.218230 Jun 16 16:17:35.349779 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 338/676] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:35 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:36.363252 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0be69cde-82d7-47d2-841c-221e5153f5d4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:36.365097 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0be69cde-82d7-47d2-841c-221e5153f5d4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:36.372060 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0be69cde-82d7-47d2-841c-221e5153f5d4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:36.372546 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0be69cde-82d7-47d2-841c-221e5153f5d4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:36.374083 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0be69cde-82d7-47d2-841c-221e5153f5d4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:36.374773 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0be69cde-82d7-47d2-841c-221e5153f5d4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:36.572445 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0be69cde-82d7-47d2-841c-221e5153f5d4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:36.581246 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0be69cde-82d7-47d2-841c-221e5153f5d4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:36.583087 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0be69cde-82d7-47d2-841c-221e5153f5d4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:36.584479 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0be69cde-82d7-47d2-841c-221e5153f5d4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1739 microversion: 2.20 time: 0.225853 Jun 16 16:17:36.585214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 339/677] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:36 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:36.789525 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-960e2c45-eb84-4b4f-bafe-ecfffe45df04 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:36.790121 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-960e2c45-eb84-4b4f-bafe-ecfffe45df04 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:36.796617 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-960e2c45-eb84-4b4f-bafe-ecfffe45df04 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:36.797065 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-960e2c45-eb84-4b4f-bafe-ecfffe45df04 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:36.797866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-960e2c45-eb84-4b4f-bafe-ecfffe45df04 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:36.798449 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-960e2c45-eb84-4b4f-bafe-ecfffe45df04 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:36.887774 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-960e2c45-eb84-4b4f-bafe-ecfffe45df04 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lazy-loading 'services' on Instance uuid 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:17:36.972501 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-960e2c45-eb84-4b4f-bafe-ecfffe45df04 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6/os-volume_attachments/989fabbe-48e8-40f2-8124-1420f8642466" status: 202 len: 0 microversion: 2.1 time: 0.186109 Jun 16 16:17:36.973582 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 339/678] 10.222.0.88 () {58 vars in 1415 bytes} [Thu Jun 16 16:17:36 2022] DELETE /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6/os-volume_attachments/989fabbe-48e8-40f2-8124-1420f8642466 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:17:37.606372 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bca45fa8-6826-4272-a90a-b41e161d94dd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:37.608070 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-bca45fa8-6826-4272-a90a-b41e161d94dd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:37.615904 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bca45fa8-6826-4272-a90a-b41e161d94dd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:37.616656 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bca45fa8-6826-4272-a90a-b41e161d94dd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:37.617707 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bca45fa8-6826-4272-a90a-b41e161d94dd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:37.618591 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bca45fa8-6826-4272-a90a-b41e161d94dd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:37.780235 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bca45fa8-6826-4272-a90a-b41e161d94dd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:37.790338 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bca45fa8-6826-4272-a90a-b41e161d94dd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:37.791908 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bca45fa8-6826-4272-a90a-b41e161d94dd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:37.793459 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-bca45fa8-6826-4272-a90a-b41e161d94dd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1739 microversion: 2.20 time: 0.190605 Jun 16 16:17:37.794292 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 340/679] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:37 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:38.940721 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1efac66a-2793-4a90-b968-9710f0350a76 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:38.941427 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1efac66a-2793-4a90-b968-9710f0350a76 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:38.947790 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1efac66a-2793-4a90-b968-9710f0350a76 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:38.948237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1efac66a-2793-4a90-b968-9710f0350a76 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:38.948998 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1efac66a-2793-4a90-b968-9710f0350a76 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:38.949431 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1efac66a-2793-4a90-b968-9710f0350a76 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:39.091882 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1efac66a-2793-4a90-b968-9710f0350a76 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:39.101641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1efac66a-2793-4a90-b968-9710f0350a76 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:39.103844 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1efac66a-2793-4a90-b968-9710f0350a76 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:39.105107 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1efac66a-2793-4a90-b968-9710f0350a76 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1739 microversion: 2.20 time: 0.292515 Jun 16 16:17:39.117229 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 340/680] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:38 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1739 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:40.124357 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3d76d72d-46ab-4853-a7dd-648a53c063de tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:40.124991 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3d76d72d-46ab-4853-a7dd-648a53c063de tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:40.132820 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3d76d72d-46ab-4853-a7dd-648a53c063de tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:40.133190 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3d76d72d-46ab-4853-a7dd-648a53c063de tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:40.134080 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3d76d72d-46ab-4853-a7dd-648a53c063de tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:40.134969 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3d76d72d-46ab-4853-a7dd-648a53c063de tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:40.279901 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3d76d72d-46ab-4853-a7dd-648a53c063de tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:40.290183 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3d76d72d-46ab-4853-a7dd-648a53c063de tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:40.291675 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3d76d72d-46ab-4853-a7dd-648a53c063de tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:40.293094 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3d76d72d-46ab-4853-a7dd-648a53c063de tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1739 microversion: 2.20 time: 0.172625 Jun 16 16:17:40.293673 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 341/681] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:40 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:41.311000 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1e1108c6-20a3-4176-8973-cc848c841178 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:41.311637 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1e1108c6-20a3-4176-8973-cc848c841178 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:41.318302 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1e1108c6-20a3-4176-8973-cc848c841178 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:41.318751 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1e1108c6-20a3-4176-8973-cc848c841178 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:41.319519 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1e1108c6-20a3-4176-8973-cc848c841178 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:41.319957 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1e1108c6-20a3-4176-8973-cc848c841178 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:41.470373 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1e1108c6-20a3-4176-8973-cc848c841178 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:41.480181 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1e1108c6-20a3-4176-8973-cc848c841178 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:41.481692 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1e1108c6-20a3-4176-8973-cc848c841178 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:41.482881 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1e1108c6-20a3-4176-8973-cc848c841178 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1739 microversion: 2.20 time: 0.175697 Jun 16 16:17:41.483439 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 341/682] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:41 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:42.501098 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-98d0a965-8486-4e0d-8ab7-dc5149c64839 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:42.502083 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-98d0a965-8486-4e0d-8ab7-dc5149c64839 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:42.509903 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-98d0a965-8486-4e0d-8ab7-dc5149c64839 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:42.510355 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-98d0a965-8486-4e0d-8ab7-dc5149c64839 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:42.511124 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-98d0a965-8486-4e0d-8ab7-dc5149c64839 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:42.511558 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-98d0a965-8486-4e0d-8ab7-dc5149c64839 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:42.695082 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-98d0a965-8486-4e0d-8ab7-dc5149c64839 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:42.704567 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-98d0a965-8486-4e0d-8ab7-dc5149c64839 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:42.707024 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-98d0a965-8486-4e0d-8ab7-dc5149c64839 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:42.708477 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-98d0a965-8486-4e0d-8ab7-dc5149c64839 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1739 microversion: 2.20 time: 0.211402 Jun 16 16:17:42.719668 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 342/683] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:42 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:43.222972 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-10e5d059-bfbd-4bdd-a3da-1bc7977bb3c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Action: 'create', calling method: .version_select at 0x7f6f0cf1ac10>, body: {"keypair": {"name": "tempest-keypair-416222513", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzn1HotzYSDvJnBhjZXy9fagHfcboxw7P6GRD7mYfGN+3CEeik1CLfiCIx6etXokD04J4RvFYUu2oAsU4YwseZymua6IW3TxIrI9Ix/RQnHaxEOxb+c2dk3I9DIo+7QnQ=="}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:43.240575 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-10e5d059-bfbd-4bdd-a3da-1bc7977bb3c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Getting quotas for project c1cdf363c2e44af5b0d8cd748c58235b. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:17:43.245009 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-10e5d059-bfbd-4bdd-a3da-1bc7977bb3c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Getting quotas for user bfbcc9b45bc341228bcc0f2192040224 and project c1cdf363c2e44af5b0d8cd748c58235b. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:17:43.274901 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-10e5d059-bfbd-4bdd-a3da-1bc7977bb3c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056445 Jun 16 16:17:43.275792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 342/684] 10.222.0.88 () {60 vars in 1158 bytes} [Thu Jun 16 16:17:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:17:43.727992 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-05a76fca-1388-4e10-80be-1bdc1a54940c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:43.729881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-05a76fca-1388-4e10-80be-1bdc1a54940c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:43.751797 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05a76fca-1388-4e10-80be-1bdc1a54940c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:43.752688 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05a76fca-1388-4e10-80be-1bdc1a54940c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:43.754672 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05a76fca-1388-4e10-80be-1bdc1a54940c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:43.758521 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05a76fca-1388-4e10-80be-1bdc1a54940c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:43.943292 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-05a76fca-1388-4e10-80be-1bdc1a54940c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:43.962324 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-05a76fca-1388-4e10-80be-1bdc1a54940c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:43.964699 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-05a76fca-1388-4e10-80be-1bdc1a54940c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:43.966129 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-05a76fca-1388-4e10-80be-1bdc1a54940c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1739 microversion: 2.20 time: 0.242722 Jun 16 16:17:43.967259 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 343/685] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:43 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:44.610094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-dc1d8cc9-83b4-497e-942a-b1fd0fe516fe tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:44.611278 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dc1d8cc9-83b4-497e-942a-b1fd0fe516fe tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:44.614039 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:44.623558 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dc1d8cc9-83b4-497e-942a-b1fd0fe516fe tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:44.624279 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dc1d8cc9-83b4-497e-942a-b1fd0fe516fe tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:44.625323 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dc1d8cc9-83b4-497e-942a-b1fd0fe516fe tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:44.625986 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dc1d8cc9-83b4-497e-942a-b1fd0fe516fe tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:44.668009 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dc1d8cc9-83b4-497e-942a-b1fd0fe516fe tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:17:44.781353 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-dc1d8cc9-83b4-497e-942a-b1fd0fe516fe tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 204 len: 0 microversion: 2.1 time: 0.174859 Jun 16 16:17:44.785746 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 343/686] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:17:44 2022] DELETE /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:17:44.790605 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f472f221-9fa8-4b3a-9012-9b16cc970b6c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:44.791402 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f472f221-9fa8-4b3a-9012-9b16cc970b6c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:44.800200 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f472f221-9fa8-4b3a-9012-9b16cc970b6c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:44.804674 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f472f221-9fa8-4b3a-9012-9b16cc970b6c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:44.805750 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f472f221-9fa8-4b3a-9012-9b16cc970b6c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:44.806336 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f472f221-9fa8-4b3a-9012-9b16cc970b6c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:44.815736 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-54303f1e-1713-48ea-9656-902b0e8aaa73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-312784423", "imageRef": "d2716dc1-3d4d-4f62-b0af-c38986f2a3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4704a63-fabf-4303-b16d-892673b27ab3"}], "security_groups": [{"name": "tempest-securitygroup--1874072907"}], "key_name": "tempest-keypair-416222513", "user_data": "}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:45.038786 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-54303f1e-1713-48ea-9656-902b0e8aaa73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] validate_networks() for [('b4704a63-fabf-4303-b16d-892673b27ab3', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:17:45.060556 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f472f221-9fa8-4b3a-9012-9b16cc970b6c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:45.069317 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f472f221-9fa8-4b3a-9012-9b16cc970b6c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1513 microversion: 2.1 time: 0.282432 Jun 16 16:17:45.070224 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 344/687] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:44 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1513 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:45.078938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fe1153c1-ae46-49ee-a73a-17805ec24c2f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:45.080325 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fe1153c1-ae46-49ee-a73a-17805ec24c2f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:45.096200 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fe1153c1-ae46-49ee-a73a-17805ec24c2f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:45.096702 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fe1153c1-ae46-49ee-a73a-17805ec24c2f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:45.097486 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fe1153c1-ae46-49ee-a73a-17805ec24c2f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:45.098524 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fe1153c1-ae46-49ee-a73a-17805ec24c2f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:45.400559 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fe1153c1-ae46-49ee-a73a-17805ec24c2f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:45.410806 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fe1153c1-ae46-49ee-a73a-17805ec24c2f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:45.412007 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fe1153c1-ae46-49ee-a73a-17805ec24c2f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:45.413477 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fe1153c1-ae46-49ee-a73a-17805ec24c2f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1739 microversion: 2.20 time: 0.342178 Jun 16 16:17:45.414096 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 345/688] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:45 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1739 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:45.773614 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-54303f1e-1713-48ea-9656-902b0e8aaa73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:17:45.774299 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-54303f1e-1713-48ea-9656-902b0e8aaa73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:17:45.774533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-54303f1e-1713-48ea-9656-902b0e8aaa73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:17:45.774929 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-54303f1e-1713-48ea-9656-902b0e8aaa73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:17:45.775348 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-54303f1e-1713-48ea-9656-902b0e8aaa73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:17:45.785314 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-54303f1e-1713-48ea-9656-902b0e8aaa73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:45.785798 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-54303f1e-1713-48ea-9656-902b0e8aaa73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:45.786603 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-54303f1e-1713-48ea-9656-902b0e8aaa73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:45.787041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-54303f1e-1713-48ea-9656-902b0e8aaa73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:45.795526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:45.810461 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-54303f1e-1713-48ea-9656-902b0e8aaa73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Getting quotas for project c1cdf363c2e44af5b0d8cd748c58235b. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:17:45.815191 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-54303f1e-1713-48ea-9656-902b0e8aaa73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Getting quotas for user bfbcc9b45bc341228bcc0f2192040224 and project c1cdf363c2e44af5b0d8cd748c58235b. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:17:45.834553 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-54303f1e-1713-48ea-9656-902b0e8aaa73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:17:45.837930 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-54303f1e-1713-48ea-9656-902b0e8aaa73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2716dc1-3d4d-4f62-b0af-c38986f2a3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:17:45.890575 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-54303f1e-1713-48ea-9656-902b0e8aaa73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.081510 Jun 16 16:17:45.891812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 344/689] 10.222.0.88 () {60 vars in 1146 bytes} [Thu Jun 16 16:17:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:17:45.910809 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c3ec5d20-55f5-41a6-b625-87fbbf2e5a0e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:45.912501 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c3ec5d20-55f5-41a6-b625-87fbbf2e5a0e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:46.009979 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c3ec5d20-55f5-41a6-b625-87fbbf2e5a0e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:46.018014 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c3ec5d20-55f5-41a6-b625-87fbbf2e5a0e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1240 microversion: 2.1 time: 0.119427 Jun 16 16:17:46.018806 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 346/690] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:45 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1240 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:46.086323 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7c6bd442-955b-4aee-adcd-22064224b5ae tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:46.087044 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7c6bd442-955b-4aee-adcd-22064224b5ae tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:46.094815 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7c6bd442-955b-4aee-adcd-22064224b5ae tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:46.095367 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7c6bd442-955b-4aee-adcd-22064224b5ae tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:46.096211 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7c6bd442-955b-4aee-adcd-22064224b5ae tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:46.097231 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7c6bd442-955b-4aee-adcd-22064224b5ae tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:46.249342 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7c6bd442-955b-4aee-adcd-22064224b5ae tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:46.257455 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7c6bd442-955b-4aee-adcd-22064224b5ae tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1513 microversion: 2.1 time: 0.175401 Jun 16 16:17:46.258001 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 345/691] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:46 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:46.432363 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c47fd1bb-f129-4d41-8eeb-8c09885b6157 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:46.433879 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c47fd1bb-f129-4d41-8eeb-8c09885b6157 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:46.441013 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c47fd1bb-f129-4d41-8eeb-8c09885b6157 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:46.441467 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c47fd1bb-f129-4d41-8eeb-8c09885b6157 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:46.442266 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c47fd1bb-f129-4d41-8eeb-8c09885b6157 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:46.442708 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c47fd1bb-f129-4d41-8eeb-8c09885b6157 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:46.581687 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c47fd1bb-f129-4d41-8eeb-8c09885b6157 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:46.589773 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c47fd1bb-f129-4d41-8eeb-8c09885b6157 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:46.591257 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c47fd1bb-f129-4d41-8eeb-8c09885b6157 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:46.592451 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c47fd1bb-f129-4d41-8eeb-8c09885b6157 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1739 microversion: 2.20 time: 0.164595 Jun 16 16:17:46.593011 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 347/692] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:46 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:47.035353 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3f99abde-3613-49a5-ab9c-73f4c907cea8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:47.035967 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3f99abde-3613-49a5-ab9c-73f4c907cea8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:47.042728 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3f99abde-3613-49a5-ab9c-73f4c907cea8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:47.043174 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3f99abde-3613-49a5-ab9c-73f4c907cea8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:47.043943 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3f99abde-3613-49a5-ab9c-73f4c907cea8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:47.044375 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3f99abde-3613-49a5-ab9c-73f4c907cea8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:47.105261 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3f99abde-3613-49a5-ab9c-73f4c907cea8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:47.113359 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3f99abde-3613-49a5-ab9c-73f4c907cea8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1244 microversion: 2.1 time: 0.082376 Jun 16 16:17:47.113964 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 346/693] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:47 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:47.275035 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a54520c1-ec8d-4b52-8935-e120c8f5613d tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:47.275659 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a54520c1-ec8d-4b52-8935-e120c8f5613d tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:47.281824 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a54520c1-ec8d-4b52-8935-e120c8f5613d tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:47.282285 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a54520c1-ec8d-4b52-8935-e120c8f5613d tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:47.283036 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a54520c1-ec8d-4b52-8935-e120c8f5613d tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:47.283472 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a54520c1-ec8d-4b52-8935-e120c8f5613d tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:47.413090 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a54520c1-ec8d-4b52-8935-e120c8f5613d tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:47.420931 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a54520c1-ec8d-4b52-8935-e120c8f5613d tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1513 microversion: 2.1 time: 0.149714 Jun 16 16:17:47.421383 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 348/694] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:47 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:47.611462 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-62b78bc0-019f-41d7-a56b-223b617e54cd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:47.612020 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-62b78bc0-019f-41d7-a56b-223b617e54cd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:47.618712 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-62b78bc0-019f-41d7-a56b-223b617e54cd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:47.619166 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-62b78bc0-019f-41d7-a56b-223b617e54cd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:47.619934 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-62b78bc0-019f-41d7-a56b-223b617e54cd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:47.620372 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-62b78bc0-019f-41d7-a56b-223b617e54cd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:47.753784 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-62b78bc0-019f-41d7-a56b-223b617e54cd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:47.761793 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-62b78bc0-019f-41d7-a56b-223b617e54cd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:47.763311 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-62b78bc0-019f-41d7-a56b-223b617e54cd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:47.764469 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-62b78bc0-019f-41d7-a56b-223b617e54cd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1739 microversion: 2.20 time: 0.157145 Jun 16 16:17:47.765026 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 347/695] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:47 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:48.132197 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f92397eb-a1d9-43ce-94c0-c502a16b132a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:48.132947 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f92397eb-a1d9-43ce-94c0-c502a16b132a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:48.139259 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f92397eb-a1d9-43ce-94c0-c502a16b132a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:48.139796 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f92397eb-a1d9-43ce-94c0-c502a16b132a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:48.140646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f92397eb-a1d9-43ce-94c0-c502a16b132a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:48.141317 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f92397eb-a1d9-43ce-94c0-c502a16b132a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:48.206327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f92397eb-a1d9-43ce-94c0-c502a16b132a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:48.214138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f92397eb-a1d9-43ce-94c0-c502a16b132a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1292 microversion: 2.1 time: 0.087792 Jun 16 16:17:48.215134 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 349/696] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:48 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1292 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:48.438308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-26ea7236-7505-40d2-a9f7-69264079ca4b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:48.438858 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-26ea7236-7505-40d2-a9f7-69264079ca4b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:48.445662 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-26ea7236-7505-40d2-a9f7-69264079ca4b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:48.446139 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-26ea7236-7505-40d2-a9f7-69264079ca4b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:48.446894 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-26ea7236-7505-40d2-a9f7-69264079ca4b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:48.447331 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-26ea7236-7505-40d2-a9f7-69264079ca4b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:48.576583 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-26ea7236-7505-40d2-a9f7-69264079ca4b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:48.583946 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-26ea7236-7505-40d2-a9f7-69264079ca4b tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1513 microversion: 2.1 time: 0.149554 Jun 16 16:17:48.584500 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 348/697] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:48 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:48.783157 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ffc07157-9ce5-4569-a2c1-13c92386b83d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:48.783839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ffc07157-9ce5-4569-a2c1-13c92386b83d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:48.790932 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ffc07157-9ce5-4569-a2c1-13c92386b83d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:48.791382 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ffc07157-9ce5-4569-a2c1-13c92386b83d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:48.792152 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ffc07157-9ce5-4569-a2c1-13c92386b83d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:48.792593 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ffc07157-9ce5-4569-a2c1-13c92386b83d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:48.924934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ffc07157-9ce5-4569-a2c1-13c92386b83d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:48.932948 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ffc07157-9ce5-4569-a2c1-13c92386b83d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:48.934479 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ffc07157-9ce5-4569-a2c1-13c92386b83d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:48.935686 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ffc07157-9ce5-4569-a2c1-13c92386b83d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1721 microversion: 2.20 time: 0.156598 Jun 16 16:17:48.936267 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 350/698] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:48 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:49.232598 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6b9a95d9-832e-46e3-8960-14a7a75e2572 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:49.233607 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6b9a95d9-832e-46e3-8960-14a7a75e2572 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:49.241629 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6b9a95d9-832e-46e3-8960-14a7a75e2572 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:49.242167 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6b9a95d9-832e-46e3-8960-14a7a75e2572 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:49.243109 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6b9a95d9-832e-46e3-8960-14a7a75e2572 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:49.243554 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6b9a95d9-832e-46e3-8960-14a7a75e2572 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:49.328115 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6b9a95d9-832e-46e3-8960-14a7a75e2572 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:49.336293 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6b9a95d9-832e-46e3-8960-14a7a75e2572 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1292 microversion: 2.1 time: 0.107888 Jun 16 16:17:49.336873 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 349/699] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:49 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1292 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:49.601173 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-992d45e0-1e82-47a6-8664-d827dfbb5e16 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:49.601817 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-992d45e0-1e82-47a6-8664-d827dfbb5e16 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:49.607945 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-992d45e0-1e82-47a6-8664-d827dfbb5e16 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:49.608391 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-992d45e0-1e82-47a6-8664-d827dfbb5e16 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:49.609182 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-992d45e0-1e82-47a6-8664-d827dfbb5e16 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:49.609614 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-992d45e0-1e82-47a6-8664-d827dfbb5e16 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:49.954955 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4406e3f5-c54b-4a88-a3d5-8008c41a797f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:49.955744 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4406e3f5-c54b-4a88-a3d5-8008c41a797f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:49.962276 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4406e3f5-c54b-4a88-a3d5-8008c41a797f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:49.962732 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4406e3f5-c54b-4a88-a3d5-8008c41a797f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:49.963508 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4406e3f5-c54b-4a88-a3d5-8008c41a797f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:49.963953 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4406e3f5-c54b-4a88-a3d5-8008c41a797f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:50.015411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-992d45e0-1e82-47a6-8664-d827dfbb5e16 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:50.022943 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-992d45e0-1e82-47a6-8664-d827dfbb5e16 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1513 microversion: 2.1 time: 0.426419 Jun 16 16:17:50.023705 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 351/700] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:49 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1513 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:50.354346 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-22922206-2dcd-4bb3-bf15-6608d9c5e569 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:50.354873 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-22922206-2dcd-4bb3-bf15-6608d9c5e569 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:50.361207 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-22922206-2dcd-4bb3-bf15-6608d9c5e569 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:50.361661 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-22922206-2dcd-4bb3-bf15-6608d9c5e569 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:50.362950 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-22922206-2dcd-4bb3-bf15-6608d9c5e569 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:50.363385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-22922206-2dcd-4bb3-bf15-6608d9c5e569 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:50.607433 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-22922206-2dcd-4bb3-bf15-6608d9c5e569 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:50.610608 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4406e3f5-c54b-4a88-a3d5-8008c41a797f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:50.618717 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-22922206-2dcd-4bb3-bf15-6608d9c5e569 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1298 microversion: 2.1 time: 0.268313 Jun 16 16:17:50.619032 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4406e3f5-c54b-4a88-a3d5-8008c41a797f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:50.619617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 352/701] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:50 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1298 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:50.620664 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4406e3f5-c54b-4a88-a3d5-8008c41a797f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:50.621878 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4406e3f5-c54b-4a88-a3d5-8008c41a797f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1721 microversion: 2.20 time: 0.670856 Jun 16 16:17:50.622562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 350/702] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:49 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1721 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:17:50.881439 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-8e53a2f8-43fd-4fe5-894b-a7400e097423 req-79c2600f-b7b0-4fdc-b0c6-2714c853117c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6", "name": "network-vif-deleted", "tag": "1aa6bca0-6f0e-4eab-a7cd-ea2fd3c6696a"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:50.892523 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-8e53a2f8-43fd-4fe5-894b-a7400e097423 req-79c2600f-b7b0-4fdc-b0c6-2714c853117c service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:50.892962 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-8e53a2f8-43fd-4fe5-894b-a7400e097423 req-79c2600f-b7b0-4fdc-b0c6-2714c853117c service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:50.906095 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-8e53a2f8-43fd-4fe5-894b-a7400e097423 req-79c2600f-b7b0-4fdc-b0c6-2714c853117c service nova] Creating event network-vif-deleted:1aa6bca0-6f0e-4eab-a7cd-ea2fd3c6696a for instance 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 on hv-cinder-83735 Jun 16 16:17:50.913529 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-8e53a2f8-43fd-4fe5-894b-a7400e097423 req-79c2600f-b7b0-4fdc-b0c6-2714c853117c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035731 Jun 16 16:17:50.914662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 353/703] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:17:51.041510 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-94a24f83-7bf6-4673-9ca5-14c91e95ea97 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:51.042256 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-94a24f83-7bf6-4673-9ca5-14c91e95ea97 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:51.048830 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-94a24f83-7bf6-4673-9ca5-14c91e95ea97 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:51.049376 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-94a24f83-7bf6-4673-9ca5-14c91e95ea97 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:51.050231 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-94a24f83-7bf6-4673-9ca5-14c91e95ea97 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:51.050945 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-94a24f83-7bf6-4673-9ca5-14c91e95ea97 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:51.084139 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-94a24f83-7bf6-4673-9ca5-14c91e95ea97 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:51.084578 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-94a24f83-7bf6-4673-9ca5-14c91e95ea97 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:51.085024 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-94a24f83-7bf6-4673-9ca5-14c91e95ea97 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lazy-loading 'fault' on Instance uuid 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:17:51.140057 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-94a24f83-7bf6-4673-9ca5-14c91e95ea97 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:51.148581 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-94a24f83-7bf6-4673-9ca5-14c91e95ea97 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1309 microversion: 2.1 time: 0.111405 Jun 16 16:17:51.149135 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 351/704] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:51 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1309 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:51.637058 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-45a35f49-33d0-4987-9896-1f4a55df630c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:51.637763 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-45a35f49-33d0-4987-9896-1f4a55df630c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:51.640107 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2726872e-66ac-434e-8a9f-9fcc248a2d60 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:51.640839 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2726872e-66ac-434e-8a9f-9fcc248a2d60 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:51.645329 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-45a35f49-33d0-4987-9896-1f4a55df630c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:51.645967 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-45a35f49-33d0-4987-9896-1f4a55df630c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:51.646811 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-45a35f49-33d0-4987-9896-1f4a55df630c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:51.647299 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-45a35f49-33d0-4987-9896-1f4a55df630c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:51.647500 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2726872e-66ac-434e-8a9f-9fcc248a2d60 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:51.647958 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2726872e-66ac-434e-8a9f-9fcc248a2d60 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:51.648730 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2726872e-66ac-434e-8a9f-9fcc248a2d60 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:51.649171 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2726872e-66ac-434e-8a9f-9fcc248a2d60 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:51.652048 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:51.853533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2726872e-66ac-434e-8a9f-9fcc248a2d60 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:51.859354 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-45a35f49-33d0-4987-9896-1f4a55df630c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:51.862782 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2726872e-66ac-434e-8a9f-9fcc248a2d60 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:51.864637 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2726872e-66ac-434e-8a9f-9fcc248a2d60 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:51.865825 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2726872e-66ac-434e-8a9f-9fcc248a2d60 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1721 microversion: 2.20 time: 0.229649 Jun 16 16:17:51.866543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 352/705] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:51 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:17:51.867934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-45a35f49-33d0-4987-9896-1f4a55df630c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1366 microversion: 2.1 time: 0.235091 Jun 16 16:17:51.868525 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 354/706] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:51 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:52.166358 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-bea82198-d874-4fd7-b7d4-9e1b1d7bec6c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:52.166970 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-bea82198-d874-4fd7-b7d4-9e1b1d7bec6c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:52.174175 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bea82198-d874-4fd7-b7d4-9e1b1d7bec6c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:52.174617 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bea82198-d874-4fd7-b7d4-9e1b1d7bec6c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:52.175382 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bea82198-d874-4fd7-b7d4-9e1b1d7bec6c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:52.175861 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bea82198-d874-4fd7-b7d4-9e1b1d7bec6c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:52.206871 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bea82198-d874-4fd7-b7d4-9e1b1d7bec6c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:52.207317 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bea82198-d874-4fd7-b7d4-9e1b1d7bec6c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:52.207760 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-bea82198-d874-4fd7-b7d4-9e1b1d7bec6c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lazy-loading 'fault' on Instance uuid 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:17:52.248097 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-bea82198-d874-4fd7-b7d4-9e1b1d7bec6c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:52.256044 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-bea82198-d874-4fd7-b7d4-9e1b1d7bec6c tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1309 microversion: 2.1 time: 0.093522 Jun 16 16:17:52.256608 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 353/707] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:52 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:52.504326 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-665c41bb-da6a-47eb-956a-3cb802a62a05 req-471c50b4-8c7a-4796-b77d-b155e10a47e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31998833-f554-4e9e-8215-6694a9d01970", "name": "network-vif-unplugged", "status": "completed", "tag": "45b1ab78-929d-4b1a-90a1-4777fb503a47"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:52.513208 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-665c41bb-da6a-47eb-956a-3cb802a62a05 req-471c50b4-8c7a-4796-b77d-b155e10a47e0 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:52.513637 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-665c41bb-da6a-47eb-956a-3cb802a62a05 req-471c50b4-8c7a-4796-b77d-b155e10a47e0 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:52.526677 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-665c41bb-da6a-47eb-956a-3cb802a62a05 req-471c50b4-8c7a-4796-b77d-b155e10a47e0 service nova] Creating event network-vif-unplugged:45b1ab78-929d-4b1a-90a1-4777fb503a47 for instance 31998833-f554-4e9e-8215-6694a9d01970 on hv-cinder-83735 Jun 16 16:17:52.531602 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-665c41bb-da6a-47eb-956a-3cb802a62a05 req-471c50b4-8c7a-4796-b77d-b155e10a47e0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031520 Jun 16 16:17:52.532199 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 355/708] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:17:52.884438 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cd4ae6bf-f4ec-47fd-a36e-faf770282c58 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:52.885049 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-cd4ae6bf-f4ec-47fd-a36e-faf770282c58 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:52.885189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-92960ea6-99fb-40b7-bf0a-95d17e4f18fe tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:52.885852 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-92960ea6-99fb-40b7-bf0a-95d17e4f18fe tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:52.891251 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cd4ae6bf-f4ec-47fd-a36e-faf770282c58 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:52.891703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cd4ae6bf-f4ec-47fd-a36e-faf770282c58 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:52.892140 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-92960ea6-99fb-40b7-bf0a-95d17e4f18fe tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:52.892475 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cd4ae6bf-f4ec-47fd-a36e-faf770282c58 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:52.892631 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-92960ea6-99fb-40b7-bf0a-95d17e4f18fe tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:52.892917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cd4ae6bf-f4ec-47fd-a36e-faf770282c58 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:52.894012 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-92960ea6-99fb-40b7-bf0a-95d17e4f18fe tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:52.894599 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-92960ea6-99fb-40b7-bf0a-95d17e4f18fe tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:53.092919 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-92960ea6-99fb-40b7-bf0a-95d17e4f18fe tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:53.098982 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cd4ae6bf-f4ec-47fd-a36e-faf770282c58 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:53.101533 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-92960ea6-99fb-40b7-bf0a-95d17e4f18fe tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1366 microversion: 2.1 time: 0.220516 Jun 16 16:17:53.102354 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 356/709] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:52 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:17:53.107506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cd4ae6bf-f4ec-47fd-a36e-faf770282c58 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:53.109084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cd4ae6bf-f4ec-47fd-a36e-faf770282c58 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:53.110667 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-cd4ae6bf-f4ec-47fd-a36e-faf770282c58 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1721 microversion: 2.20 time: 0.229837 Jun 16 16:17:53.110899 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 354/710] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:52 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:53.273160 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6a7866f4-c528-42e1-a115-da4be762fe65 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:53.273808 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6a7866f4-c528-42e1-a115-da4be762fe65 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:53.279792 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6a7866f4-c528-42e1-a115-da4be762fe65 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:53.280242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6a7866f4-c528-42e1-a115-da4be762fe65 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:53.281001 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6a7866f4-c528-42e1-a115-da4be762fe65 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:53.281436 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6a7866f4-c528-42e1-a115-da4be762fe65 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:53.325213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6a7866f4-c528-42e1-a115-da4be762fe65 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:53.325761 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6a7866f4-c528-42e1-a115-da4be762fe65 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:53.326435 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-6a7866f4-c528-42e1-a115-da4be762fe65 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lazy-loading 'fault' on Instance uuid 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:17:53.369199 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6a7866f4-c528-42e1-a115-da4be762fe65 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a98ea9b90174a24b57b3875e9df2ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e363bcf5ed47529b6464cf954a31ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:53.376677 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6a7866f4-c528-42e1-a115-da4be762fe65 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 200 len: 1309 microversion: 2.1 time: 0.107397 Jun 16 16:17:53.377247 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 357/711] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:53 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:54.045896 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-bb118b44-4adb-4ac2-bbac-2bd477a18e6c req-60063e13-0966-49a4-8643-2edb56a22e9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1331116f-adf2-4957-9d58-6436d217e73f", "tag": "715cac73-0f61-46bf-aeb4-a3dbfabc5eab"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:54.058380 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-bb118b44-4adb-4ac2-bbac-2bd477a18e6c req-60063e13-0966-49a4-8643-2edb56a22e9f service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:54.059270 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-bb118b44-4adb-4ac2-bbac-2bd477a18e6c req-60063e13-0966-49a4-8643-2edb56a22e9f service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:54.082374 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-bb118b44-4adb-4ac2-bbac-2bd477a18e6c req-60063e13-0966-49a4-8643-2edb56a22e9f service nova] Creating event network-changed:715cac73-0f61-46bf-aeb4-a3dbfabc5eab for instance 1331116f-adf2-4957-9d58-6436d217e73f on hv-cinder-83735 Jun 16 16:17:54.087422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-bb118b44-4adb-4ac2-bbac-2bd477a18e6c req-60063e13-0966-49a4-8643-2edb56a22e9f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045940 Jun 16 16:17:54.088029 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 355/712] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:17:54.119181 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e06ad90d-1794-4338-82e8-69630c49346c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:54.120228 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e06ad90d-1794-4338-82e8-69630c49346c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:54.127808 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e06ad90d-1794-4338-82e8-69630c49346c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:54.128532 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e06ad90d-1794-4338-82e8-69630c49346c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:54.130800 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e06ad90d-1794-4338-82e8-69630c49346c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:54.131835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e06ad90d-1794-4338-82e8-69630c49346c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:54.134384 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ae8ce2b7-5a59-4937-817c-497123442a69 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:54.136306 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ae8ce2b7-5a59-4937-817c-497123442a69 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:54.149228 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ae8ce2b7-5a59-4937-817c-497123442a69 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:54.149948 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ae8ce2b7-5a59-4937-817c-497123442a69 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:54.151089 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ae8ce2b7-5a59-4937-817c-497123442a69 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:54.151700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ae8ce2b7-5a59-4937-817c-497123442a69 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:54.362038 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e06ad90d-1794-4338-82e8-69630c49346c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:54.366152 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ae8ce2b7-5a59-4937-817c-497123442a69 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:54.369616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e06ad90d-1794-4338-82e8-69630c49346c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1366 microversion: 2.1 time: 0.254488 Jun 16 16:17:54.370430 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 358/713] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:54 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:54.374315 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ae8ce2b7-5a59-4937-817c-497123442a69 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:54.375813 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ae8ce2b7-5a59-4937-817c-497123442a69 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:54.376964 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ae8ce2b7-5a59-4937-817c-497123442a69 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1724 microversion: 2.20 time: 0.248714 Jun 16 16:17:54.378040 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 356/714] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:54 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:54.395416 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5df0964a-0819-4c7c-a92f-8183e8f90b31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1638550-5f9a-4cf5-8eab-4950632b04de"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:54.396488 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5df0964a-0819-4c7c-a92f-8183e8f90b31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:54.398045 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-def5962b-e26e-451d-8ce6-48f6ab7e8b20 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:54.398677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-def5962b-e26e-451d-8ce6-48f6ab7e8b20 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] [instance: 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:54.402593 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5df0964a-0819-4c7c-a92f-8183e8f90b31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:54.403042 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5df0964a-0819-4c7c-a92f-8183e8f90b31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:54.403801 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5df0964a-0819-4c7c-a92f-8183e8f90b31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:54.404358 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5df0964a-0819-4c7c-a92f-8183e8f90b31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:54.404886 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-def5962b-e26e-451d-8ce6-48f6ab7e8b20 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:54.405354 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-def5962b-e26e-451d-8ce6-48f6ab7e8b20 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:54.406139 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-def5962b-e26e-451d-8ce6-48f6ab7e8b20 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:54.406575 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-def5962b-e26e-451d-8ce6-48f6ab7e8b20 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:54.420353 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-def5962b-e26e-451d-8ce6-48f6ab7e8b20 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] HTTP exception thrown: Instance 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 could not be found. Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-def5962b-e26e-451d-8ce6-48f6ab7e8b20 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Request method failure captured: Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 HTTP/1.1 Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1a5kByetA5LRErMKGDqozeUBDW287QigK5V8LF1pJt-CA4btu9QKzReck9B_tbslwej1xP9d-CYt1hOGQP3SCiZVJ89gzAVpO1FVz-v3VHTTVtsOnkQ8QwL6VQS8hf1xVB0dOcXg7iFDN30z1aE3rQKQnQhI3IP2IrOKt4kSCZqpmw Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: f5e363bcf5ed47529b6464cf954a31ea Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-VolumesSnapshotTestJSON-261890931 Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:17:54.422052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:17:54.423649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f5e363bcf5ed47529b6464cf954a31ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f5e363bcf5ed47529b6464cf954a31ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f5e363bcf5ed47529b6464cf954a31ea", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f5e363bcf5ed47529b6464cf954a31ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:17:54.423649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-VolumesSnapshotTestJSON-261890931 Jun 16 16:17:54.423649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: f5e363bcf5ed47529b6464cf954a31ea Jun 16 16:17:54.423649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-261890931 Jun 16 16:17:54.423649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-VolumesSnapshotTestJSON-261890931-project Jun 16 16:17:54.423649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:17:54.423649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:17:54.423649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: 1a98ea9b90174a24b57b3875e9df2ecd Jun 16 16:17:54.423649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-VolumesSnapshotTestJSON-261890931-project Jun 16 16:17:54.423649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:17:54.423649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Instance 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 could not be found. Jun 16 16:17:54.423649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': '4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6'} Jun 16 16:17:54.424533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:17:54.424533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:17:54.424533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:17:54.424533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:17:54.424533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:17:54.424533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:17:54.424533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:17:54.424533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:17:54.424533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:17:54.424533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:17:54.424533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 could not be found. Jun 16 16:17:54.424533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:17:54.424533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:17:54.424533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:17:54.424533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:17:54.424533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:17:54.424533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:17:54.424533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:17:54.424533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:17:54.424533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:17:54.426084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:17:54.426084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:17:54.426084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:17:54.426084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:17:54.426084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:17:54.426084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:17:54.426084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:17:54.426084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 could not be found. Jun 16 16:17:54.426084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:17:54.426084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:17:54.426084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:17:54.426084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:17:54.426084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:17:54.426084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:17:54.426084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:17:54.426084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:17:54.426084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 could not be found. Jun 16 16:17:54.426084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:17:54.427737 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-def5962b-e26e-451d-8ce6-48f6ab7e8b20 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] Returning 404 to user: Instance 4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:17:54.427737 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-def5962b-e26e-451d-8ce6-48f6ab7e8b20 tempest-VolumesSnapshotTestJSON-261890931 tempest-VolumesSnapshotTestJSON-261890931-project] 10.222.0.88 "GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6" status: 404 len: 111 microversion: 2.1 time: 0.029284 Jun 16 16:17:54.427737 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 357/715] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:54 2022] GET /compute/v2.1/servers/4adf9f2e-19db-438f-99e8-2b6a0bb5f8e6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:17:54.744238 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5df0964a-0819-4c7c-a92f-8183e8f90b31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "POST /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.353341 Jun 16 16:17:54.746173 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 359/716] 10.222.0.88 () {62 vars in 1363 bytes} [Thu Jun 16 16:17:54 2022] POST /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970/os-volume_attachments => generated 188 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:17:54.879605 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-639aa3e5-1b7e-4678-ac39-a9c681c3842a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:17:54.880160 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-639aa3e5-1b7e-4678-ac39-a9c681c3842a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:54.886993 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-639aa3e5-1b7e-4678-ac39-a9c681c3842a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:54.887439 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-639aa3e5-1b7e-4678-ac39-a9c681c3842a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:54.888223 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-639aa3e5-1b7e-4678-ac39-a9c681c3842a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:54.888749 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-639aa3e5-1b7e-4678-ac39-a9c681c3842a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:54.985256 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-639aa3e5-1b7e-4678-ac39-a9c681c3842a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "POST /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970/action" status: 202 len: 0 microversion: 2.20 time: 0.110501 Jun 16 16:17:54.988887 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 358/717] 10.222.0.88 () {62 vars in 1318 bytes} [Thu Jun 16 16:17:54 2022] POST /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 16:17:54.994290 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-539af637-30a2-4813-a976-70929de7aeb1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:54.995226 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-539af637-30a2-4813-a976-70929de7aeb1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:55.003631 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-539af637-30a2-4813-a976-70929de7aeb1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:55.004381 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-539af637-30a2-4813-a976-70929de7aeb1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:55.005238 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-539af637-30a2-4813-a976-70929de7aeb1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:55.005935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-539af637-30a2-4813-a976-70929de7aeb1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:55.152772 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-539af637-30a2-4813-a976-70929de7aeb1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:55.162638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-539af637-30a2-4813-a976-70929de7aeb1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:55.164227 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-539af637-30a2-4813-a976-70929de7aeb1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:55.165404 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-539af637-30a2-4813-a976-70929de7aeb1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1750 microversion: 2.20 time: 0.175202 Jun 16 16:17:55.166309 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 360/718] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:54 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1750 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:55.387362 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e4db1750-8686-4620-a17a-4852b08a4fdc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:55.388013 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e4db1750-8686-4620-a17a-4852b08a4fdc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:55.395060 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e4db1750-8686-4620-a17a-4852b08a4fdc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:55.395503 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e4db1750-8686-4620-a17a-4852b08a4fdc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:55.396494 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e4db1750-8686-4620-a17a-4852b08a4fdc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:55.396924 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e4db1750-8686-4620-a17a-4852b08a4fdc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:55.544783 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e4db1750-8686-4620-a17a-4852b08a4fdc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:55.554214 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e4db1750-8686-4620-a17a-4852b08a4fdc tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1366 microversion: 2.1 time: 0.170970 Jun 16 16:17:55.555134 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 359/719] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:55 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:56.183939 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-75e1c1f4-1491-4e2a-8c9e-0727774433ba tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:56.184536 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-75e1c1f4-1491-4e2a-8c9e-0727774433ba tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:56.186525 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:56.192626 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-75e1c1f4-1491-4e2a-8c9e-0727774433ba tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:56.193067 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-75e1c1f4-1491-4e2a-8c9e-0727774433ba tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:56.193849 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-75e1c1f4-1491-4e2a-8c9e-0727774433ba tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:56.194279 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-75e1c1f4-1491-4e2a-8c9e-0727774433ba tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:56.323927 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-75e1c1f4-1491-4e2a-8c9e-0727774433ba tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:56.332794 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-75e1c1f4-1491-4e2a-8c9e-0727774433ba tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:56.334315 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-75e1c1f4-1491-4e2a-8c9e-0727774433ba tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:56.335453 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-75e1c1f4-1491-4e2a-8c9e-0727774433ba tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1750 microversion: 2.20 time: 0.155422 Jun 16 16:17:56.336006 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 361/720] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:56 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:56.572548 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2540f367-7243-4477-85c0-b83e09c46635 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:56.573165 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2540f367-7243-4477-85c0-b83e09c46635 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:56.575126 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:56.575791 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=10 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:56.583079 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2540f367-7243-4477-85c0-b83e09c46635 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:56.583531 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2540f367-7243-4477-85c0-b83e09c46635 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:56.584305 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2540f367-7243-4477-85c0-b83e09c46635 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:56.584792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2540f367-7243-4477-85c0-b83e09c46635 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:56.715961 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2540f367-7243-4477-85c0-b83e09c46635 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:56.723911 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2540f367-7243-4477-85c0-b83e09c46635 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1366 microversion: 2.1 time: 0.155280 Jun 16 16:17:56.724475 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 360/721] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:56 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:57.354949 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0c782972-0c16-4794-9358-01f2d1b8197d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:57.355548 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0c782972-0c16-4794-9358-01f2d1b8197d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:57.363587 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0c782972-0c16-4794-9358-01f2d1b8197d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:57.364029 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0c782972-0c16-4794-9358-01f2d1b8197d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:57.364784 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0c782972-0c16-4794-9358-01f2d1b8197d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:57.365214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0c782972-0c16-4794-9358-01f2d1b8197d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:57.498366 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0c782972-0c16-4794-9358-01f2d1b8197d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:57.508234 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0c782972-0c16-4794-9358-01f2d1b8197d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:57.509710 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0c782972-0c16-4794-9358-01f2d1b8197d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:57.510899 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0c782972-0c16-4794-9358-01f2d1b8197d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1750 microversion: 2.20 time: 0.160098 Jun 16 16:17:57.511550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 362/722] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:57 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:57.740797 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6b1bdde3-b675-42d1-8f98-0ea4113d9987 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:57.741340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6b1bdde3-b675-42d1-8f98-0ea4113d9987 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:57.747857 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6b1bdde3-b675-42d1-8f98-0ea4113d9987 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:57.748306 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6b1bdde3-b675-42d1-8f98-0ea4113d9987 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:57.749071 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6b1bdde3-b675-42d1-8f98-0ea4113d9987 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:57.749508 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6b1bdde3-b675-42d1-8f98-0ea4113d9987 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:57.754028 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:57.887750 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6b1bdde3-b675-42d1-8f98-0ea4113d9987 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:57.895712 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6b1bdde3-b675-42d1-8f98-0ea4113d9987 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1366 microversion: 2.1 time: 0.158935 Jun 16 16:17:57.896278 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 361/723] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:57 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:58.529707 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-584fb5b2-c42a-435e-b0c1-2cc38990b066 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:58.530338 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-584fb5b2-c42a-435e-b0c1-2cc38990b066 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:58.537039 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-584fb5b2-c42a-435e-b0c1-2cc38990b066 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:58.537483 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-584fb5b2-c42a-435e-b0c1-2cc38990b066 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:58.538286 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-584fb5b2-c42a-435e-b0c1-2cc38990b066 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:58.538714 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-584fb5b2-c42a-435e-b0c1-2cc38990b066 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:58.668095 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-584fb5b2-c42a-435e-b0c1-2cc38990b066 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:58.676968 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-584fb5b2-c42a-435e-b0c1-2cc38990b066 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:58.678501 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-584fb5b2-c42a-435e-b0c1-2cc38990b066 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:58.679658 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-584fb5b2-c42a-435e-b0c1-2cc38990b066 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1750 microversion: 2.20 time: 0.153876 Jun 16 16:17:58.680220 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 363/724] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:58 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1750 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:17:58.913401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0bd83a66-df23-4e95-9a89-fdea4fe67a42 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:58.914059 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0bd83a66-df23-4e95-9a89-fdea4fe67a42 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:58.920225 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0bd83a66-df23-4e95-9a89-fdea4fe67a42 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:58.920679 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0bd83a66-df23-4e95-9a89-fdea4fe67a42 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:58.921559 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0bd83a66-df23-4e95-9a89-fdea4fe67a42 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:58.922059 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0bd83a66-df23-4e95-9a89-fdea4fe67a42 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:59.054258 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0bd83a66-df23-4e95-9a89-fdea4fe67a42 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:59.061935 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0bd83a66-df23-4e95-9a89-fdea4fe67a42 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1366 microversion: 2.1 time: 0.152444 Jun 16 16:17:59.062520 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 362/725] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:17:58 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:17:59.698668 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bc13de92-ba48-490c-964a-03c805296eca tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:17:59.699383 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-bc13de92-ba48-490c-964a-03c805296eca tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:17:59.706568 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bc13de92-ba48-490c-964a-03c805296eca tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:59.707013 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bc13de92-ba48-490c-964a-03c805296eca tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:59.707770 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bc13de92-ba48-490c-964a-03c805296eca tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:17:59.708206 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bc13de92-ba48-490c-964a-03c805296eca tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:17:59.842736 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bc13de92-ba48-490c-964a-03c805296eca tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:59.851778 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bc13de92-ba48-490c-964a-03c805296eca tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:59.853276 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bc13de92-ba48-490c-964a-03c805296eca tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:17:59.854461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-bc13de92-ba48-490c-964a-03c805296eca tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1750 microversion: 2.20 time: 0.159770 Jun 16 16:17:59.855019 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 364/726] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:17:59 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:00.078733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-58e89f6d-a5c6-40c4-816f-f7e172dff505 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:00.079446 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-58e89f6d-a5c6-40c4-816f-f7e172dff505 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:00.086002 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-58e89f6d-a5c6-40c4-816f-f7e172dff505 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:00.086453 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-58e89f6d-a5c6-40c4-816f-f7e172dff505 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:00.087223 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-58e89f6d-a5c6-40c4-816f-f7e172dff505 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:00.087656 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-58e89f6d-a5c6-40c4-816f-f7e172dff505 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:00.218220 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-58e89f6d-a5c6-40c4-816f-f7e172dff505 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:00.226105 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-58e89f6d-a5c6-40c4-816f-f7e172dff505 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1366 microversion: 2.1 time: 0.151170 Jun 16 16:18:00.226674 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 363/727] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:00 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:00.873280 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4124540f-32b9-48fd-9a7c-106d9cb554e1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:00.873918 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4124540f-32b9-48fd-9a7c-106d9cb554e1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:00.880918 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4124540f-32b9-48fd-9a7c-106d9cb554e1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:00.881368 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4124540f-32b9-48fd-9a7c-106d9cb554e1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:00.882150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4124540f-32b9-48fd-9a7c-106d9cb554e1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:00.882589 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4124540f-32b9-48fd-9a7c-106d9cb554e1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:01.015028 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4124540f-32b9-48fd-9a7c-106d9cb554e1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:01.023526 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4124540f-32b9-48fd-9a7c-106d9cb554e1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:01.025077 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4124540f-32b9-48fd-9a7c-106d9cb554e1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:01.026267 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4124540f-32b9-48fd-9a7c-106d9cb554e1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1750 microversion: 2.20 time: 0.156898 Jun 16 16:18:01.026833 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 365/728] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:00 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1750 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:01.243234 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b96b76fa-40ee-4bd2-a99d-33fbf67eb468 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:01.243855 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b96b76fa-40ee-4bd2-a99d-33fbf67eb468 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:01.250736 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b96b76fa-40ee-4bd2-a99d-33fbf67eb468 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:01.251217 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b96b76fa-40ee-4bd2-a99d-33fbf67eb468 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:01.251995 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b96b76fa-40ee-4bd2-a99d-33fbf67eb468 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:01.252924 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b96b76fa-40ee-4bd2-a99d-33fbf67eb468 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:01.382131 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b96b76fa-40ee-4bd2-a99d-33fbf67eb468 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:01.389730 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b96b76fa-40ee-4bd2-a99d-33fbf67eb468 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1366 microversion: 2.1 time: 0.150249 Jun 16 16:18:01.390303 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 364/729] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:01 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:02.045002 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-30f7b143-b3ec-4b6d-bbee-34220a27aa4f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:02.045634 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-30f7b143-b3ec-4b6d-bbee-34220a27aa4f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:02.053032 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-30f7b143-b3ec-4b6d-bbee-34220a27aa4f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:02.053487 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-30f7b143-b3ec-4b6d-bbee-34220a27aa4f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:02.054363 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-30f7b143-b3ec-4b6d-bbee-34220a27aa4f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:02.054723 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-30f7b143-b3ec-4b6d-bbee-34220a27aa4f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:02.192113 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-30f7b143-b3ec-4b6d-bbee-34220a27aa4f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:02.200705 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-30f7b143-b3ec-4b6d-bbee-34220a27aa4f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:02.202230 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-30f7b143-b3ec-4b6d-bbee-34220a27aa4f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:02.203404 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-30f7b143-b3ec-4b6d-bbee-34220a27aa4f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1750 microversion: 2.20 time: 0.162505 Jun 16 16:18:02.203968 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 366/730] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:02 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:02.407205 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c21f670c-5e01-4b31-94b2-9b044894728f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:02.407843 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c21f670c-5e01-4b31-94b2-9b044894728f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:02.415232 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c21f670c-5e01-4b31-94b2-9b044894728f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:02.415687 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c21f670c-5e01-4b31-94b2-9b044894728f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:02.416463 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c21f670c-5e01-4b31-94b2-9b044894728f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:02.416888 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c21f670c-5e01-4b31-94b2-9b044894728f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:02.575013 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c21f670c-5e01-4b31-94b2-9b044894728f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:02.583929 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c21f670c-5e01-4b31-94b2-9b044894728f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1366 microversion: 2.1 time: 0.181217 Jun 16 16:18:02.584502 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 365/731] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:02 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:18:03.224594 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3450c768-6c3c-42c2-a80a-ff9b44218550 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:03.225196 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3450c768-6c3c-42c2-a80a-ff9b44218550 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:03.231839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3450c768-6c3c-42c2-a80a-ff9b44218550 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:03.232277 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3450c768-6c3c-42c2-a80a-ff9b44218550 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:03.233138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3450c768-6c3c-42c2-a80a-ff9b44218550 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:03.233642 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3450c768-6c3c-42c2-a80a-ff9b44218550 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:03.413216 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3450c768-6c3c-42c2-a80a-ff9b44218550 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:03.421802 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3450c768-6c3c-42c2-a80a-ff9b44218550 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:03.423417 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3450c768-6c3c-42c2-a80a-ff9b44218550 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:03.425152 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3450c768-6c3c-42c2-a80a-ff9b44218550 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1752 microversion: 2.20 time: 0.205197 Jun 16 16:18:03.425709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 367/732] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:03 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1752 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:03.602090 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3b55d9fb-69fd-49e5-9c1f-41c3fad7ef9e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:03.602717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3b55d9fb-69fd-49e5-9c1f-41c3fad7ef9e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:03.610493 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3b55d9fb-69fd-49e5-9c1f-41c3fad7ef9e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:03.610978 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3b55d9fb-69fd-49e5-9c1f-41c3fad7ef9e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:03.612332 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3b55d9fb-69fd-49e5-9c1f-41c3fad7ef9e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:03.612766 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3b55d9fb-69fd-49e5-9c1f-41c3fad7ef9e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:03.750973 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3b55d9fb-69fd-49e5-9c1f-41c3fad7ef9e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:03.758889 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3b55d9fb-69fd-49e5-9c1f-41c3fad7ef9e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1366 microversion: 2.1 time: 0.161582 Jun 16 16:18:03.759525 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 366/733] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:03 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:04.186778 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-2ff24f76-50d9-4276-8b0d-2f86a55d9a37 req-ee387ad8-de1e-4ca9-a708-0bfb4996ebf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1331116f-adf2-4957-9d58-6436d217e73f", "name": "network-vif-plugged", "status": "completed", "tag": "715cac73-0f61-46bf-aeb4-a3dbfabc5eab"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:04.190485 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=64 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:04.196997 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-2ff24f76-50d9-4276-8b0d-2f86a55d9a37 req-ee387ad8-de1e-4ca9-a708-0bfb4996ebf0 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:04.197436 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-2ff24f76-50d9-4276-8b0d-2f86a55d9a37 req-ee387ad8-de1e-4ca9-a708-0bfb4996ebf0 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:04.208976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-2ff24f76-50d9-4276-8b0d-2f86a55d9a37 req-ee387ad8-de1e-4ca9-a708-0bfb4996ebf0 service nova] Creating event network-vif-plugged:715cac73-0f61-46bf-aeb4-a3dbfabc5eab for instance 1331116f-adf2-4957-9d58-6436d217e73f on hv-cinder-83735 Jun 16 16:18:04.213917 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-2ff24f76-50d9-4276-8b0d-2f86a55d9a37 req-ee387ad8-de1e-4ca9-a708-0bfb4996ebf0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030776 Jun 16 16:18:04.214690 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 368/734] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:18:04.445944 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d990efcc-d420-47a4-ba5a-5adab01f0837 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:04.446583 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d990efcc-d420-47a4-ba5a-5adab01f0837 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:04.453142 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d990efcc-d420-47a4-ba5a-5adab01f0837 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:04.453805 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d990efcc-d420-47a4-ba5a-5adab01f0837 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:04.455678 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d990efcc-d420-47a4-ba5a-5adab01f0837 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:04.456412 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d990efcc-d420-47a4-ba5a-5adab01f0837 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:04.635754 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d990efcc-d420-47a4-ba5a-5adab01f0837 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:04.644958 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d990efcc-d420-47a4-ba5a-5adab01f0837 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:04.646568 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d990efcc-d420-47a4-ba5a-5adab01f0837 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:04.647817 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d990efcc-d420-47a4-ba5a-5adab01f0837 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1752 microversion: 2.20 time: 0.206076 Jun 16 16:18:04.648373 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 367/735] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:04 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1752 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:04.778334 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-dbdce695-f992-47b8-b68f-55fa50bea8b9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:04.779136 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-dbdce695-f992-47b8-b68f-55fa50bea8b9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:04.785794 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dbdce695-f992-47b8-b68f-55fa50bea8b9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:04.786243 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dbdce695-f992-47b8-b68f-55fa50bea8b9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:04.786996 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dbdce695-f992-47b8-b68f-55fa50bea8b9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:04.787426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dbdce695-f992-47b8-b68f-55fa50bea8b9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:04.791562 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:04.930395 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-dbdce695-f992-47b8-b68f-55fa50bea8b9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:04.938726 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-dbdce695-f992-47b8-b68f-55fa50bea8b9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1366 microversion: 2.1 time: 0.165153 Jun 16 16:18:04.939313 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 369/736] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:04 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:05.666407 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f566f13e-0790-4b02-85b1-ca51d1661b98 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:05.666931 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f566f13e-0790-4b02-85b1-ca51d1661b98 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:05.673755 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f566f13e-0790-4b02-85b1-ca51d1661b98 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:05.674212 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f566f13e-0790-4b02-85b1-ca51d1661b98 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:05.674995 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f566f13e-0790-4b02-85b1-ca51d1661b98 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:05.675438 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f566f13e-0790-4b02-85b1-ca51d1661b98 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:05.818854 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f566f13e-0790-4b02-85b1-ca51d1661b98 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:05.827722 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f566f13e-0790-4b02-85b1-ca51d1661b98 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:05.829229 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f566f13e-0790-4b02-85b1-ca51d1661b98 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:05.830993 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f566f13e-0790-4b02-85b1-ca51d1661b98 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1752 microversion: 2.20 time: 0.168072 Jun 16 16:18:05.831553 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 368/737] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:05 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:05.955830 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a93bcb87-7f5a-4968-81fa-2c1a1a21e4cb tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:05.956379 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a93bcb87-7f5a-4968-81fa-2c1a1a21e4cb tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:05.963188 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a93bcb87-7f5a-4968-81fa-2c1a1a21e4cb tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:05.963657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a93bcb87-7f5a-4968-81fa-2c1a1a21e4cb tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:05.964410 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a93bcb87-7f5a-4968-81fa-2c1a1a21e4cb tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:05.964838 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a93bcb87-7f5a-4968-81fa-2c1a1a21e4cb tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:06.099145 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a93bcb87-7f5a-4968-81fa-2c1a1a21e4cb tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:06.108393 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a93bcb87-7f5a-4968-81fa-2c1a1a21e4cb tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1366 microversion: 2.1 time: 0.156570 Jun 16 16:18:06.108973 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 370/738] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:05 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:06.850276 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3ac04d3a-2a0f-4a67-9abe-045156ebbdfd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:06.850829 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3ac04d3a-2a0f-4a67-9abe-045156ebbdfd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:06.857391 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3ac04d3a-2a0f-4a67-9abe-045156ebbdfd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:06.857876 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3ac04d3a-2a0f-4a67-9abe-045156ebbdfd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:06.858635 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3ac04d3a-2a0f-4a67-9abe-045156ebbdfd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:06.859063 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3ac04d3a-2a0f-4a67-9abe-045156ebbdfd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:06.987921 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3ac04d3a-2a0f-4a67-9abe-045156ebbdfd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:06.996419 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3ac04d3a-2a0f-4a67-9abe-045156ebbdfd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:06.998008 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3ac04d3a-2a0f-4a67-9abe-045156ebbdfd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:06.999166 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3ac04d3a-2a0f-4a67-9abe-045156ebbdfd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.153745 Jun 16 16:18:06.999726 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 369/739] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:06 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:07.124822 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ef6e1b9c-ec4f-4061-b39f-27f995f6eb38 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:07.125631 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ef6e1b9c-ec4f-4061-b39f-27f995f6eb38 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:07.132485 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ef6e1b9c-ec4f-4061-b39f-27f995f6eb38 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:07.132923 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ef6e1b9c-ec4f-4061-b39f-27f995f6eb38 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:07.133686 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ef6e1b9c-ec4f-4061-b39f-27f995f6eb38 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:07.134147 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ef6e1b9c-ec4f-4061-b39f-27f995f6eb38 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:07.282712 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ef6e1b9c-ec4f-4061-b39f-27f995f6eb38 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:07.290616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ef6e1b9c-ec4f-4061-b39f-27f995f6eb38 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1366 microversion: 2.1 time: 0.169524 Jun 16 16:18:07.291294 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 371/740] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:07 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:08.018693 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d226d05b-6c37-49b4-8881-adf6f176e8eb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:08.019296 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d226d05b-6c37-49b4-8881-adf6f176e8eb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:08.025862 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d226d05b-6c37-49b4-8881-adf6f176e8eb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:08.026302 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d226d05b-6c37-49b4-8881-adf6f176e8eb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:08.027056 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d226d05b-6c37-49b4-8881-adf6f176e8eb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:08.027490 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d226d05b-6c37-49b4-8881-adf6f176e8eb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:08.162820 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d226d05b-6c37-49b4-8881-adf6f176e8eb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:08.171383 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d226d05b-6c37-49b4-8881-adf6f176e8eb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:08.173056 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d226d05b-6c37-49b4-8881-adf6f176e8eb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:08.174283 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d226d05b-6c37-49b4-8881-adf6f176e8eb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.159986 Jun 16 16:18:08.174847 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 370/741] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:08 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:08.308016 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-aa9f4561-a1ca-4a54-a550-8e7fe3ae02c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:08.308638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-aa9f4561-a1ca-4a54-a550-8e7fe3ae02c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:08.316150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-aa9f4561-a1ca-4a54-a550-8e7fe3ae02c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:08.316643 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-aa9f4561-a1ca-4a54-a550-8e7fe3ae02c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:08.317414 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-aa9f4561-a1ca-4a54-a550-8e7fe3ae02c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:08.317883 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-aa9f4561-a1ca-4a54-a550-8e7fe3ae02c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:08.449468 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-aa9f4561-a1ca-4a54-a550-8e7fe3ae02c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:08.457151 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-aa9f4561-a1ca-4a54-a550-8e7fe3ae02c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1556 microversion: 2.1 time: 0.153011 Jun 16 16:18:08.457744 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 372/742] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:18:08 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:18:08.473688 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2cdb50ee-bc7b-4751-83af-463d54a98b4f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:08.474229 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2cdb50ee-bc7b-4751-83af-463d54a98b4f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:08.480594 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2cdb50ee-bc7b-4751-83af-463d54a98b4f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:08.481118 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2cdb50ee-bc7b-4751-83af-463d54a98b4f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:08.482078 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2cdb50ee-bc7b-4751-83af-463d54a98b4f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:08.482511 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2cdb50ee-bc7b-4751-83af-463d54a98b4f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:08.561591 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2cdb50ee-bc7b-4751-83af-463d54a98b4f tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092124 Jun 16 16:18:08.562227 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 371/743] 10.222.0.88 () {58 vars in 1274 bytes} [Thu Jun 16 16:18:08 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:09.192039 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d77068cf-097b-49c6-9b77-dd310ae089c2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:09.192643 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d77068cf-097b-49c6-9b77-dd310ae089c2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:09.198690 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d77068cf-097b-49c6-9b77-dd310ae089c2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:09.199133 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d77068cf-097b-49c6-9b77-dd310ae089c2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:09.199897 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d77068cf-097b-49c6-9b77-dd310ae089c2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:09.200331 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d77068cf-097b-49c6-9b77-dd310ae089c2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:09.445430 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d77068cf-097b-49c6-9b77-dd310ae089c2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:09.454179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d77068cf-097b-49c6-9b77-dd310ae089c2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:09.456325 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d77068cf-097b-49c6-9b77-dd310ae089c2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:09.457659 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d77068cf-097b-49c6-9b77-dd310ae089c2 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.269695 Jun 16 16:18:09.458257 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 373/744] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:09 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:09.903714 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-30e3a0c4-21d7-43ba-93df-6e0e9815237e req-22b620af-49f0-4bf3-ba0b-f74b5a920bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1331116f-adf2-4957-9d58-6436d217e73f", "tag": "715cac73-0f61-46bf-aeb4-a3dbfabc5eab"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:09.912493 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-30e3a0c4-21d7-43ba-93df-6e0e9815237e req-22b620af-49f0-4bf3-ba0b-f74b5a920bd9 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:09.912943 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-30e3a0c4-21d7-43ba-93df-6e0e9815237e req-22b620af-49f0-4bf3-ba0b-f74b5a920bd9 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:09.924835 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-30e3a0c4-21d7-43ba-93df-6e0e9815237e req-22b620af-49f0-4bf3-ba0b-f74b5a920bd9 service nova] Creating event network-changed:715cac73-0f61-46bf-aeb4-a3dbfabc5eab for instance 1331116f-adf2-4957-9d58-6436d217e73f on hv-cinder-83735 Jun 16 16:18:09.930075 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-30e3a0c4-21d7-43ba-93df-6e0e9815237e req-22b620af-49f0-4bf3-ba0b-f74b5a920bd9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085957 Jun 16 16:18:09.930684 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 372/745] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:10.477155 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-94f30b4f-efa6-4bf2-8e21-95e17c0b6b94 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:10.477740 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-94f30b4f-efa6-4bf2-8e21-95e17c0b6b94 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:10.484720 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-94f30b4f-efa6-4bf2-8e21-95e17c0b6b94 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:10.485175 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-94f30b4f-efa6-4bf2-8e21-95e17c0b6b94 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:10.485976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-94f30b4f-efa6-4bf2-8e21-95e17c0b6b94 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:10.486425 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-94f30b4f-efa6-4bf2-8e21-95e17c0b6b94 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:10.626913 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-94f30b4f-efa6-4bf2-8e21-95e17c0b6b94 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:10.636067 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-94f30b4f-efa6-4bf2-8e21-95e17c0b6b94 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:10.637849 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-94f30b4f-efa6-4bf2-8e21-95e17c0b6b94 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:10.639039 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-94f30b4f-efa6-4bf2-8e21-95e17c0b6b94 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.166409 Jun 16 16:18:10.639610 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 374/746] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:10 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:11.658982 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d67b5cd3-7a8f-4136-903d-fec057d6be47 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:11.659616 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d67b5cd3-7a8f-4136-903d-fec057d6be47 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:11.666318 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d67b5cd3-7a8f-4136-903d-fec057d6be47 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:11.666766 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d67b5cd3-7a8f-4136-903d-fec057d6be47 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:11.667528 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d67b5cd3-7a8f-4136-903d-fec057d6be47 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:11.667959 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d67b5cd3-7a8f-4136-903d-fec057d6be47 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:11.799240 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d67b5cd3-7a8f-4136-903d-fec057d6be47 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:11.808000 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d67b5cd3-7a8f-4136-903d-fec057d6be47 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:11.809486 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d67b5cd3-7a8f-4136-903d-fec057d6be47 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:11.810680 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d67b5cd3-7a8f-4136-903d-fec057d6be47 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.156635 Jun 16 16:18:11.811245 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 373/747] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:11 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:12.828663 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a2170c3f-7b8b-4a8f-8680-ca21ea201b93 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:12.829188 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a2170c3f-7b8b-4a8f-8680-ca21ea201b93 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:12.835623 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a2170c3f-7b8b-4a8f-8680-ca21ea201b93 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:12.836068 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a2170c3f-7b8b-4a8f-8680-ca21ea201b93 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:12.836818 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a2170c3f-7b8b-4a8f-8680-ca21ea201b93 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:12.837246 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a2170c3f-7b8b-4a8f-8680-ca21ea201b93 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:12.993122 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a2170c3f-7b8b-4a8f-8680-ca21ea201b93 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:13.002603 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a2170c3f-7b8b-4a8f-8680-ca21ea201b93 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:13.004117 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a2170c3f-7b8b-4a8f-8680-ca21ea201b93 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:13.005284 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a2170c3f-7b8b-4a8f-8680-ca21ea201b93 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.180603 Jun 16 16:18:13.005866 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 375/748] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:12 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:14.024086 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cd24fb99-8d31-4a97-a6ff-ad5697832064 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:14.024702 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-cd24fb99-8d31-4a97-a6ff-ad5697832064 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:14.031800 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cd24fb99-8d31-4a97-a6ff-ad5697832064 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:14.032250 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cd24fb99-8d31-4a97-a6ff-ad5697832064 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:14.033064 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cd24fb99-8d31-4a97-a6ff-ad5697832064 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:14.033509 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cd24fb99-8d31-4a97-a6ff-ad5697832064 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:14.343849 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cd24fb99-8d31-4a97-a6ff-ad5697832064 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:14.353822 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cd24fb99-8d31-4a97-a6ff-ad5697832064 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:14.355340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cd24fb99-8d31-4a97-a6ff-ad5697832064 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:14.356604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-cd24fb99-8d31-4a97-a6ff-ad5697832064 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.336450 Jun 16 16:18:14.357172 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 374/749] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:14 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:15.381224 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-84d3d60b-8b49-4686-8903-d55b13f0f9ab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:15.382037 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-84d3d60b-8b49-4686-8903-d55b13f0f9ab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:15.389773 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-84d3d60b-8b49-4686-8903-d55b13f0f9ab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:15.390238 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-84d3d60b-8b49-4686-8903-d55b13f0f9ab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:15.391242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-84d3d60b-8b49-4686-8903-d55b13f0f9ab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:15.391686 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-84d3d60b-8b49-4686-8903-d55b13f0f9ab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:15.534159 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-84d3d60b-8b49-4686-8903-d55b13f0f9ab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:15.542962 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-84d3d60b-8b49-4686-8903-d55b13f0f9ab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:15.544450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-84d3d60b-8b49-4686-8903-d55b13f0f9ab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:15.545597 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-84d3d60b-8b49-4686-8903-d55b13f0f9ab tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.169767 Jun 16 16:18:15.546191 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 376/750] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:15 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:16.566051 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3768919c-b3b7-4baa-a88f-2f9556931c31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:16.566969 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3768919c-b3b7-4baa-a88f-2f9556931c31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:16.570028 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:16.580071 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3768919c-b3b7-4baa-a88f-2f9556931c31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:16.580764 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3768919c-b3b7-4baa-a88f-2f9556931c31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:16.581901 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3768919c-b3b7-4baa-a88f-2f9556931c31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:16.582409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3768919c-b3b7-4baa-a88f-2f9556931c31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:16.731027 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3768919c-b3b7-4baa-a88f-2f9556931c31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:16.740592 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3768919c-b3b7-4baa-a88f-2f9556931c31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:16.742177 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3768919c-b3b7-4baa-a88f-2f9556931c31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:16.743569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3768919c-b3b7-4baa-a88f-2f9556931c31 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.183477 Jun 16 16:18:16.744349 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 375/751] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:16 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:18:17.762691 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-760bdd36-e13d-495a-89ab-dba58ede7873 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:17.763295 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-760bdd36-e13d-495a-89ab-dba58ede7873 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:17.770696 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-760bdd36-e13d-495a-89ab-dba58ede7873 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:17.771141 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-760bdd36-e13d-495a-89ab-dba58ede7873 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:17.771893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-760bdd36-e13d-495a-89ab-dba58ede7873 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:17.772326 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-760bdd36-e13d-495a-89ab-dba58ede7873 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:17.916209 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-760bdd36-e13d-495a-89ab-dba58ede7873 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:17.924852 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-760bdd36-e13d-495a-89ab-dba58ede7873 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:17.926534 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-760bdd36-e13d-495a-89ab-dba58ede7873 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:17.927702 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-760bdd36-e13d-495a-89ab-dba58ede7873 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.168899 Jun 16 16:18:17.928268 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 377/752] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:17 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:18:18.945872 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2060fcfe-ba6e-44b7-90fc-b060937c5016 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:18.947666 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2060fcfe-ba6e-44b7-90fc-b060937c5016 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:18.956413 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2060fcfe-ba6e-44b7-90fc-b060937c5016 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:18.957004 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2060fcfe-ba6e-44b7-90fc-b060937c5016 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:18.957879 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2060fcfe-ba6e-44b7-90fc-b060937c5016 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:18.958390 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2060fcfe-ba6e-44b7-90fc-b060937c5016 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:19.123952 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2060fcfe-ba6e-44b7-90fc-b060937c5016 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:19.138315 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2060fcfe-ba6e-44b7-90fc-b060937c5016 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:19.140451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2060fcfe-ba6e-44b7-90fc-b060937c5016 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:19.142197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2060fcfe-ba6e-44b7-90fc-b060937c5016 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.200218 Jun 16 16:18:19.151014 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 376/753] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:18 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:20.161228 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9e35724f-1fcc-407a-88d3-605046e79aba tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:20.161981 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9e35724f-1fcc-407a-88d3-605046e79aba tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:20.168783 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9e35724f-1fcc-407a-88d3-605046e79aba tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:20.169244 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9e35724f-1fcc-407a-88d3-605046e79aba tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:20.170120 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9e35724f-1fcc-407a-88d3-605046e79aba tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:20.170637 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9e35724f-1fcc-407a-88d3-605046e79aba tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:20.313252 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9e35724f-1fcc-407a-88d3-605046e79aba tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:20.325297 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9e35724f-1fcc-407a-88d3-605046e79aba tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:20.326901 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9e35724f-1fcc-407a-88d3-605046e79aba tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:20.328274 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9e35724f-1fcc-407a-88d3-605046e79aba tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.171505 Jun 16 16:18:20.328738 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 378/754] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:20 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:18:21.347542 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ef3fdcd5-291f-456b-b263-9f915a7ab6f6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:21.348542 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ef3fdcd5-291f-456b-b263-9f915a7ab6f6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:21.354998 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ef3fdcd5-291f-456b-b263-9f915a7ab6f6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:21.355451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ef3fdcd5-291f-456b-b263-9f915a7ab6f6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:21.356243 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ef3fdcd5-291f-456b-b263-9f915a7ab6f6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:21.356695 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ef3fdcd5-291f-456b-b263-9f915a7ab6f6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:21.510409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ef3fdcd5-291f-456b-b263-9f915a7ab6f6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:21.519694 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ef3fdcd5-291f-456b-b263-9f915a7ab6f6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:21.521198 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ef3fdcd5-291f-456b-b263-9f915a7ab6f6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:21.522412 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ef3fdcd5-291f-456b-b263-9f915a7ab6f6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.179251 Jun 16 16:18:21.522958 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 377/755] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:21 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:22.540521 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8341a7f6-6868-4d4e-8fb0-6398963d7d43 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:22.541211 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8341a7f6-6868-4d4e-8fb0-6398963d7d43 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:22.548790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8341a7f6-6868-4d4e-8fb0-6398963d7d43 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:22.549239 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8341a7f6-6868-4d4e-8fb0-6398963d7d43 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:22.550041 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8341a7f6-6868-4d4e-8fb0-6398963d7d43 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:22.550477 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8341a7f6-6868-4d4e-8fb0-6398963d7d43 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:22.690927 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8341a7f6-6868-4d4e-8fb0-6398963d7d43 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:22.699493 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8341a7f6-6868-4d4e-8fb0-6398963d7d43 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:22.701062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8341a7f6-6868-4d4e-8fb0-6398963d7d43 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:22.702274 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8341a7f6-6868-4d4e-8fb0-6398963d7d43 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.165655 Jun 16 16:18:22.702848 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 379/756] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:22 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:23.721442 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7ab81b7b-0ec6-41a2-a012-e002ffcd061c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:23.722185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7ab81b7b-0ec6-41a2-a012-e002ffcd061c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:23.729847 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7ab81b7b-0ec6-41a2-a012-e002ffcd061c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:23.730428 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7ab81b7b-0ec6-41a2-a012-e002ffcd061c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:23.731210 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7ab81b7b-0ec6-41a2-a012-e002ffcd061c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:23.731695 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7ab81b7b-0ec6-41a2-a012-e002ffcd061c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:23.874320 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7ab81b7b-0ec6-41a2-a012-e002ffcd061c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:23.877984 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=100 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:23.884784 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7ab81b7b-0ec6-41a2-a012-e002ffcd061c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:23.886329 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7ab81b7b-0ec6-41a2-a012-e002ffcd061c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:23.887513 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7ab81b7b-0ec6-41a2-a012-e002ffcd061c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.170779 Jun 16 16:18:23.888086 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 378/757] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:23 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:24.908222 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f06cdb40-9bcd-4d31-a5af-14d675d15fc0 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:24.908871 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f06cdb40-9bcd-4d31-a5af-14d675d15fc0 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:24.915563 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f06cdb40-9bcd-4d31-a5af-14d675d15fc0 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:24.916013 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f06cdb40-9bcd-4d31-a5af-14d675d15fc0 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:24.916784 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f06cdb40-9bcd-4d31-a5af-14d675d15fc0 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:24.918053 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f06cdb40-9bcd-4d31-a5af-14d675d15fc0 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:25.400800 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f06cdb40-9bcd-4d31-a5af-14d675d15fc0 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:25.410659 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f06cdb40-9bcd-4d31-a5af-14d675d15fc0 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:25.412145 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f06cdb40-9bcd-4d31-a5af-14d675d15fc0 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:25.413306 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f06cdb40-9bcd-4d31-a5af-14d675d15fc0 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.511666 Jun 16 16:18:25.414134 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 380/758] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:24 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:26.432683 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e897b11d-c049-4a21-9126-ad2fdb2b4fc5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:26.433517 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e897b11d-c049-4a21-9126-ad2fdb2b4fc5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:26.445428 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e897b11d-c049-4a21-9126-ad2fdb2b4fc5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:26.445927 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e897b11d-c049-4a21-9126-ad2fdb2b4fc5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:26.446720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e897b11d-c049-4a21-9126-ad2fdb2b4fc5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:26.447169 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e897b11d-c049-4a21-9126-ad2fdb2b4fc5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:26.580618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e897b11d-c049-4a21-9126-ad2fdb2b4fc5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:26.589047 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e897b11d-c049-4a21-9126-ad2fdb2b4fc5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:26.590667 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e897b11d-c049-4a21-9126-ad2fdb2b4fc5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:26.591808 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e897b11d-c049-4a21-9126-ad2fdb2b4fc5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.163262 Jun 16 16:18:26.592362 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 379/759] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:26 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:27.611283 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-be99e272-37bd-4d80-b58d-0e16ed18fb2a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:27.612127 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-be99e272-37bd-4d80-b58d-0e16ed18fb2a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:27.619597 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-be99e272-37bd-4d80-b58d-0e16ed18fb2a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:27.620054 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-be99e272-37bd-4d80-b58d-0e16ed18fb2a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:27.620816 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-be99e272-37bd-4d80-b58d-0e16ed18fb2a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:27.621234 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-be99e272-37bd-4d80-b58d-0e16ed18fb2a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:27.762518 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-be99e272-37bd-4d80-b58d-0e16ed18fb2a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:27.771670 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-be99e272-37bd-4d80-b58d-0e16ed18fb2a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:27.773207 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-be99e272-37bd-4d80-b58d-0e16ed18fb2a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:27.774426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-be99e272-37bd-4d80-b58d-0e16ed18fb2a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.167589 Jun 16 16:18:27.774995 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 381/760] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:27 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:28.793551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f1ef26ea-e902-4670-a34a-a5fe7d78491e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:28.794656 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f1ef26ea-e902-4670-a34a-a5fe7d78491e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:28.802959 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f1ef26ea-e902-4670-a34a-a5fe7d78491e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:28.803603 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f1ef26ea-e902-4670-a34a-a5fe7d78491e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:28.804633 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f1ef26ea-e902-4670-a34a-a5fe7d78491e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:28.805130 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f1ef26ea-e902-4670-a34a-a5fe7d78491e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:28.952884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f1ef26ea-e902-4670-a34a-a5fe7d78491e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:28.962214 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f1ef26ea-e902-4670-a34a-a5fe7d78491e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:28.963720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f1ef26ea-e902-4670-a34a-a5fe7d78491e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:28.964899 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f1ef26ea-e902-4670-a34a-a5fe7d78491e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.175653 Jun 16 16:18:28.965471 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 380/761] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:28 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:29.987975 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cd2eb01f-714d-48f9-bd71-32ab0fe14e0b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:29.988598 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-cd2eb01f-714d-48f9-bd71-32ab0fe14e0b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:29.995113 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cd2eb01f-714d-48f9-bd71-32ab0fe14e0b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:29.995561 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cd2eb01f-714d-48f9-bd71-32ab0fe14e0b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:29.996306 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cd2eb01f-714d-48f9-bd71-32ab0fe14e0b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:29.996738 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cd2eb01f-714d-48f9-bd71-32ab0fe14e0b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:30.143141 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cd2eb01f-714d-48f9-bd71-32ab0fe14e0b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:30.151518 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cd2eb01f-714d-48f9-bd71-32ab0fe14e0b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:30.153021 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cd2eb01f-714d-48f9-bd71-32ab0fe14e0b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:30.154197 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cd2eb01f-714d-48f9-bd71-32ab0fe14e0b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.174268 Jun 16 16:18:30.154753 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 382/762] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:29 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:31.173003 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e7a59d2a-defe-4856-ac11-14f5f75fda8c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:31.174217 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e7a59d2a-defe-4856-ac11-14f5f75fda8c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:31.180184 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e7a59d2a-defe-4856-ac11-14f5f75fda8c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:31.180713 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e7a59d2a-defe-4856-ac11-14f5f75fda8c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:31.181485 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e7a59d2a-defe-4856-ac11-14f5f75fda8c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:31.181956 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e7a59d2a-defe-4856-ac11-14f5f75fda8c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:31.316277 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e7a59d2a-defe-4856-ac11-14f5f75fda8c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:31.324555 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e7a59d2a-defe-4856-ac11-14f5f75fda8c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:31.326179 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e7a59d2a-defe-4856-ac11-14f5f75fda8c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:31.327322 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e7a59d2a-defe-4856-ac11-14f5f75fda8c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.158392 Jun 16 16:18:31.327877 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 381/763] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:31 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:32.344574 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2d890da0-d8ef-49b2-934b-2bae5ffe925d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:32.345775 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2d890da0-d8ef-49b2-934b-2bae5ffe925d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:32.352194 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2d890da0-d8ef-49b2-934b-2bae5ffe925d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:32.352637 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2d890da0-d8ef-49b2-934b-2bae5ffe925d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:32.353388 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2d890da0-d8ef-49b2-934b-2bae5ffe925d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:32.353856 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2d890da0-d8ef-49b2-934b-2bae5ffe925d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:32.480992 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2d890da0-d8ef-49b2-934b-2bae5ffe925d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:32.489182 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2d890da0-d8ef-49b2-934b-2bae5ffe925d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:32.490706 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2d890da0-d8ef-49b2-934b-2bae5ffe925d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:32.491882 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2d890da0-d8ef-49b2-934b-2bae5ffe925d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.151389 Jun 16 16:18:32.492577 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 383/764] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:32 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:33.510683 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1b56696b-d307-4f85-aace-d0dfcaa5d704 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:33.511295 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1b56696b-d307-4f85-aace-d0dfcaa5d704 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:33.518656 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1b56696b-d307-4f85-aace-d0dfcaa5d704 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:33.519109 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1b56696b-d307-4f85-aace-d0dfcaa5d704 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:33.519876 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1b56696b-d307-4f85-aace-d0dfcaa5d704 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:33.520316 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1b56696b-d307-4f85-aace-d0dfcaa5d704 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:33.656842 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1b56696b-d307-4f85-aace-d0dfcaa5d704 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:33.665898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1b56696b-d307-4f85-aace-d0dfcaa5d704 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:33.667435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1b56696b-d307-4f85-aace-d0dfcaa5d704 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:33.668691 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1b56696b-d307-4f85-aace-d0dfcaa5d704 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.161909 Jun 16 16:18:33.669258 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 382/765] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:33 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:34.686897 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-104216a7-13e6-4f99-add9-5d74e93869d9 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:34.687502 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-104216a7-13e6-4f99-add9-5d74e93869d9 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:34.690596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=32 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:34.696040 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-104216a7-13e6-4f99-add9-5d74e93869d9 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:34.696488 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-104216a7-13e6-4f99-add9-5d74e93869d9 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:34.697254 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-104216a7-13e6-4f99-add9-5d74e93869d9 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:34.697688 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-104216a7-13e6-4f99-add9-5d74e93869d9 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:34.835263 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-104216a7-13e6-4f99-add9-5d74e93869d9 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:34.837504 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=93 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:34.844976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-104216a7-13e6-4f99-add9-5d74e93869d9 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:34.846493 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-104216a7-13e6-4f99-add9-5d74e93869d9 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:34.847882 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-104216a7-13e6-4f99-add9-5d74e93869d9 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.164654 Jun 16 16:18:34.848443 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 384/766] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:34 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:35.869738 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-afe04698-9b96-4712-a983-ed7599b9c8a7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:35.870391 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-afe04698-9b96-4712-a983-ed7599b9c8a7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:35.877413 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-afe04698-9b96-4712-a983-ed7599b9c8a7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:35.877885 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-afe04698-9b96-4712-a983-ed7599b9c8a7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:35.878651 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-afe04698-9b96-4712-a983-ed7599b9c8a7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:35.879090 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-afe04698-9b96-4712-a983-ed7599b9c8a7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:36.022339 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-afe04698-9b96-4712-a983-ed7599b9c8a7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:36.030808 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-afe04698-9b96-4712-a983-ed7599b9c8a7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:36.032900 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-afe04698-9b96-4712-a983-ed7599b9c8a7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:36.034086 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-afe04698-9b96-4712-a983-ed7599b9c8a7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.170712 Jun 16 16:18:36.034640 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 383/767] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:35 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:37.055625 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cd7257bd-16ba-4714-853e-c19aa75dd844 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:37.056209 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-cd7257bd-16ba-4714-853e-c19aa75dd844 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:37.062826 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cd7257bd-16ba-4714-853e-c19aa75dd844 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:37.063262 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cd7257bd-16ba-4714-853e-c19aa75dd844 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:37.064004 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cd7257bd-16ba-4714-853e-c19aa75dd844 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:37.064434 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cd7257bd-16ba-4714-853e-c19aa75dd844 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:37.193129 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cd7257bd-16ba-4714-853e-c19aa75dd844 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:37.201625 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cd7257bd-16ba-4714-853e-c19aa75dd844 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:37.203135 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cd7257bd-16ba-4714-853e-c19aa75dd844 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:37.204284 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cd7257bd-16ba-4714-853e-c19aa75dd844 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.152560 Jun 16 16:18:37.204844 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 385/768] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:37 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:38.222105 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ec7eace2-f3a8-4ddf-b794-85dd452e08ff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:38.222960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ec7eace2-f3a8-4ddf-b794-85dd452e08ff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:38.229348 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ec7eace2-f3a8-4ddf-b794-85dd452e08ff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:38.229885 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ec7eace2-f3a8-4ddf-b794-85dd452e08ff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:38.230722 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ec7eace2-f3a8-4ddf-b794-85dd452e08ff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:38.231151 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ec7eace2-f3a8-4ddf-b794-85dd452e08ff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:38.362396 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ec7eace2-f3a8-4ddf-b794-85dd452e08ff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:38.370768 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ec7eace2-f3a8-4ddf-b794-85dd452e08ff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:38.372298 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ec7eace2-f3a8-4ddf-b794-85dd452e08ff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:38.373449 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ec7eace2-f3a8-4ddf-b794-85dd452e08ff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.155187 Jun 16 16:18:38.374089 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 384/769] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:38 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:39.391453 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-adbf8ba3-799f-4bd3-99e5-611e222e7cfb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:39.392709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-adbf8ba3-799f-4bd3-99e5-611e222e7cfb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:39.399218 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-adbf8ba3-799f-4bd3-99e5-611e222e7cfb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:39.399655 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-adbf8ba3-799f-4bd3-99e5-611e222e7cfb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:39.400395 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-adbf8ba3-799f-4bd3-99e5-611e222e7cfb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:39.400827 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-adbf8ba3-799f-4bd3-99e5-611e222e7cfb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:39.533920 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-adbf8ba3-799f-4bd3-99e5-611e222e7cfb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:39.542452 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-adbf8ba3-799f-4bd3-99e5-611e222e7cfb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:39.544023 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-adbf8ba3-799f-4bd3-99e5-611e222e7cfb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:39.545170 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-adbf8ba3-799f-4bd3-99e5-611e222e7cfb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.157843 Jun 16 16:18:39.545743 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 386/770] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:39 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:40.563332 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-72976612-9f22-4576-b18e-5fcee2391e3f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:40.563942 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-72976612-9f22-4576-b18e-5fcee2391e3f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:40.570561 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-72976612-9f22-4576-b18e-5fcee2391e3f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:40.571014 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-72976612-9f22-4576-b18e-5fcee2391e3f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:40.571780 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-72976612-9f22-4576-b18e-5fcee2391e3f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:40.572218 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-72976612-9f22-4576-b18e-5fcee2391e3f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:40.702986 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-72976612-9f22-4576-b18e-5fcee2391e3f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:40.712027 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-72976612-9f22-4576-b18e-5fcee2391e3f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:40.713541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-72976612-9f22-4576-b18e-5fcee2391e3f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:40.714710 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-72976612-9f22-4576-b18e-5fcee2391e3f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.155327 Jun 16 16:18:40.715258 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 385/771] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:40 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:41.735318 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0d72cb15-ae98-49e0-b29a-b2afdecab423 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:41.735925 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0d72cb15-ae98-49e0-b29a-b2afdecab423 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:41.741942 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0d72cb15-ae98-49e0-b29a-b2afdecab423 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:41.742416 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0d72cb15-ae98-49e0-b29a-b2afdecab423 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:41.743176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0d72cb15-ae98-49e0-b29a-b2afdecab423 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:41.743608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0d72cb15-ae98-49e0-b29a-b2afdecab423 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:41.887770 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0d72cb15-ae98-49e0-b29a-b2afdecab423 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:41.896658 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0d72cb15-ae98-49e0-b29a-b2afdecab423 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:41.898187 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0d72cb15-ae98-49e0-b29a-b2afdecab423 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:41.899348 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0d72cb15-ae98-49e0-b29a-b2afdecab423 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.168606 Jun 16 16:18:41.899910 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 387/772] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:41 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:42.918138 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3b4d757c-7f3b-4516-8ea2-1846d603d129 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:42.918825 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3b4d757c-7f3b-4516-8ea2-1846d603d129 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:42.925470 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3b4d757c-7f3b-4516-8ea2-1846d603d129 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:42.925959 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3b4d757c-7f3b-4516-8ea2-1846d603d129 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:42.926736 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3b4d757c-7f3b-4516-8ea2-1846d603d129 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:42.927174 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3b4d757c-7f3b-4516-8ea2-1846d603d129 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:43.058752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3b4d757c-7f3b-4516-8ea2-1846d603d129 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:43.067786 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3b4d757c-7f3b-4516-8ea2-1846d603d129 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:43.069294 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3b4d757c-7f3b-4516-8ea2-1846d603d129 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:43.070492 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3b4d757c-7f3b-4516-8ea2-1846d603d129 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.156367 Jun 16 16:18:43.071057 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 386/773] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:42 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:44.088647 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-47eaf437-7bcd-4969-97b2-080319700d0d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:44.089232 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-47eaf437-7bcd-4969-97b2-080319700d0d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:44.095766 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-47eaf437-7bcd-4969-97b2-080319700d0d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:44.096216 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-47eaf437-7bcd-4969-97b2-080319700d0d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:44.097046 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-47eaf437-7bcd-4969-97b2-080319700d0d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:44.097481 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-47eaf437-7bcd-4969-97b2-080319700d0d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:44.228111 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-47eaf437-7bcd-4969-97b2-080319700d0d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:44.237219 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-47eaf437-7bcd-4969-97b2-080319700d0d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:44.238803 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-47eaf437-7bcd-4969-97b2-080319700d0d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:44.240014 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-47eaf437-7bcd-4969-97b2-080319700d0d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.155291 Jun 16 16:18:44.240571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 388/774] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:44 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:44.651804 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-4c3124b4-45cb-4146-b2d1-c91399678e7b req-d254a0af-e171-44fe-8af2-f9abe48563f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31998833-f554-4e9e-8215-6694a9d01970", "name": "network-vif-plugged", "status": "completed", "tag": "45b1ab78-929d-4b1a-90a1-4777fb503a47"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:18:44.660718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-4c3124b4-45cb-4146-b2d1-c91399678e7b req-d254a0af-e171-44fe-8af2-f9abe48563f7 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:44.661158 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-4c3124b4-45cb-4146-b2d1-c91399678e7b req-d254a0af-e171-44fe-8af2-f9abe48563f7 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:44.671936 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-4c3124b4-45cb-4146-b2d1-c91399678e7b req-d254a0af-e171-44fe-8af2-f9abe48563f7 service nova] Creating event network-vif-plugged:45b1ab78-929d-4b1a-90a1-4777fb503a47 for instance 31998833-f554-4e9e-8215-6694a9d01970 on hv-cinder-83735 Jun 16 16:18:44.677804 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-4c3124b4-45cb-4146-b2d1-c91399678e7b req-d254a0af-e171-44fe-8af2-f9abe48563f7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209898 Jun 16 16:18:44.678400 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 387/775] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:18:45.257750 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0f5e688c-9d97-4c90-8f56-195dc5c2a1c3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:45.258467 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0f5e688c-9d97-4c90-8f56-195dc5c2a1c3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:45.265239 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0f5e688c-9d97-4c90-8f56-195dc5c2a1c3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:45.265685 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0f5e688c-9d97-4c90-8f56-195dc5c2a1c3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:45.266569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0f5e688c-9d97-4c90-8f56-195dc5c2a1c3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:45.267033 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0f5e688c-9d97-4c90-8f56-195dc5c2a1c3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:45.411397 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0f5e688c-9d97-4c90-8f56-195dc5c2a1c3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:45.420018 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0f5e688c-9d97-4c90-8f56-195dc5c2a1c3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:45.422196 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0f5e688c-9d97-4c90-8f56-195dc5c2a1c3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:45.423888 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0f5e688c-9d97-4c90-8f56-195dc5c2a1c3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.170007 Jun 16 16:18:45.424557 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 389/776] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:45 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:46.443072 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-410a513d-ca37-4689-8d2a-b86c9d45f9cc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:46.443680 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-410a513d-ca37-4689-8d2a-b86c9d45f9cc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:46.450030 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-410a513d-ca37-4689-8d2a-b86c9d45f9cc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:46.450573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-410a513d-ca37-4689-8d2a-b86c9d45f9cc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:46.451366 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-410a513d-ca37-4689-8d2a-b86c9d45f9cc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:46.451802 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-410a513d-ca37-4689-8d2a-b86c9d45f9cc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:46.586431 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-410a513d-ca37-4689-8d2a-b86c9d45f9cc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:46.595391 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-410a513d-ca37-4689-8d2a-b86c9d45f9cc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:46.596927 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-410a513d-ca37-4689-8d2a-b86c9d45f9cc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:46.598406 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-410a513d-ca37-4689-8d2a-b86c9d45f9cc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.160178 Jun 16 16:18:46.598967 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 388/777] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:46 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:47.616894 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ed4a241c-2384-4cb2-a4a9-98f972ebd4bc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:47.617546 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ed4a241c-2384-4cb2-a4a9-98f972ebd4bc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:47.624283 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ed4a241c-2384-4cb2-a4a9-98f972ebd4bc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:47.624722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ed4a241c-2384-4cb2-a4a9-98f972ebd4bc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:47.625476 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ed4a241c-2384-4cb2-a4a9-98f972ebd4bc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:47.625933 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ed4a241c-2384-4cb2-a4a9-98f972ebd4bc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:47.756429 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ed4a241c-2384-4cb2-a4a9-98f972ebd4bc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:47.764766 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ed4a241c-2384-4cb2-a4a9-98f972ebd4bc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:47.766276 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ed4a241c-2384-4cb2-a4a9-98f972ebd4bc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:47.767427 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ed4a241c-2384-4cb2-a4a9-98f972ebd4bc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.154426 Jun 16 16:18:47.767972 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 390/778] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:47 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:48.785099 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fc5a0d63-a1ee-46b8-8f2a-a73912e65d05 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:48.785787 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fc5a0d63-a1ee-46b8-8f2a-a73912e65d05 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:48.788213 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=28 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:48.793603 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fc5a0d63-a1ee-46b8-8f2a-a73912e65d05 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:48.794078 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fc5a0d63-a1ee-46b8-8f2a-a73912e65d05 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:48.794851 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fc5a0d63-a1ee-46b8-8f2a-a73912e65d05 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:48.795343 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fc5a0d63-a1ee-46b8-8f2a-a73912e65d05 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:48.933269 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-fc5a0d63-a1ee-46b8-8f2a-a73912e65d05 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:48.941654 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-fc5a0d63-a1ee-46b8-8f2a-a73912e65d05 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:48.943242 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-fc5a0d63-a1ee-46b8-8f2a-a73912e65d05 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:48.944396 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fc5a0d63-a1ee-46b8-8f2a-a73912e65d05 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1808 microversion: 2.20 time: 0.163794 Jun 16 16:18:48.944964 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 389/779] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:48 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:18:49.963188 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d08b2ec7-2af6-457f-bc0f-00edef7330ea tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:18:49.963797 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d08b2ec7-2af6-457f-bc0f-00edef7330ea tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:18:49.970370 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d08b2ec7-2af6-457f-bc0f-00edef7330ea tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:49.970818 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d08b2ec7-2af6-457f-bc0f-00edef7330ea tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:49.971564 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d08b2ec7-2af6-457f-bc0f-00edef7330ea tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:18:49.971997 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d08b2ec7-2af6-457f-bc0f-00edef7330ea tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:18:50.099671 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d08b2ec7-2af6-457f-bc0f-00edef7330ea tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:50.108707 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d08b2ec7-2af6-457f-bc0f-00edef7330ea tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:50.110824 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d08b2ec7-2af6-457f-bc0f-00edef7330ea tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:18:50.111999 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d08b2ec7-2af6-457f-bc0f-00edef7330ea tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1795 microversion: 2.20 time: 0.152741 Jun 16 16:18:50.112561 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 391/780] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:18:49 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1795 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:19:12.998353 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:12.999948 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=62 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:13.102868 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-152eee59-0f47-4ebd-9b6b-17aa7c8da7e9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce3d5c1a-fafd-4eb2-9bad-6b2b875c2f4c"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:13.103922 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-152eee59-0f47-4ebd-9b6b-17aa7c8da7e9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:13.110051 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-152eee59-0f47-4ebd-9b6b-17aa7c8da7e9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:13.110531 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-152eee59-0f47-4ebd-9b6b-17aa7c8da7e9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:13.111258 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-152eee59-0f47-4ebd-9b6b-17aa7c8da7e9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:13.111696 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-152eee59-0f47-4ebd-9b6b-17aa7c8da7e9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:13.391634 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-152eee59-0f47-4ebd-9b6b-17aa7c8da7e9 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "POST /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.398010 Jun 16 16:19:13.392245 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 390/781] 10.222.0.88 () {60 vars in 1322 bytes} [Thu Jun 16 16:19:12 2022] POST /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd/os-volume_attachments => generated 194 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:19:19.077053 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1604fef3-c5b3-433b-b1f7-2334ab91679d tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:19.078642 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1604fef3-c5b3-433b-b1f7-2334ab91679d tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:19.080827 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=15 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:19.081463 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=43 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:19.087173 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1604fef3-c5b3-433b-b1f7-2334ab91679d tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:19.087613 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1604fef3-c5b3-433b-b1f7-2334ab91679d tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:19.088364 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1604fef3-c5b3-433b-b1f7-2334ab91679d tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:19.088791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1604fef3-c5b3-433b-b1f7-2334ab91679d tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:19.160407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1604fef3-c5b3-433b-b1f7-2334ab91679d tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "POST /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d/action" status: 202 len: 0 microversion: 2.1 time: 0.086983 Jun 16 16:19:19.161082 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 392/782] 10.222.0.88 () {60 vars in 1277 bytes} [Thu Jun 16 16:19:19 2022] POST /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:19:19.170043 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ed2af4b1-d280-4fb7-871d-f055163d689e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:19.170941 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ed2af4b1-d280-4fb7-871d-f055163d689e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:19.177648 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ed2af4b1-d280-4fb7-871d-f055163d689e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:19.178135 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ed2af4b1-d280-4fb7-871d-f055163d689e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:19.178904 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ed2af4b1-d280-4fb7-871d-f055163d689e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:19.179343 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ed2af4b1-d280-4fb7-871d-f055163d689e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:19.322625 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ed2af4b1-d280-4fb7-871d-f055163d689e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:19.331165 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ed2af4b1-d280-4fb7-871d-f055163d689e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1752 microversion: 2.1 time: 0.165709 Jun 16 16:19:19.331654 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 391/783] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:19 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:20.350375 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0349c4c3-a1c5-4100-adbf-deb8fc3c6024 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:20.351027 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0349c4c3-a1c5-4100-adbf-deb8fc3c6024 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:20.357203 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0349c4c3-a1c5-4100-adbf-deb8fc3c6024 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:20.357657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0349c4c3-a1c5-4100-adbf-deb8fc3c6024 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:20.358440 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0349c4c3-a1c5-4100-adbf-deb8fc3c6024 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:20.358882 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0349c4c3-a1c5-4100-adbf-deb8fc3c6024 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:20.551597 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0349c4c3-a1c5-4100-adbf-deb8fc3c6024 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:20.559930 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0349c4c3-a1c5-4100-adbf-deb8fc3c6024 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1752 microversion: 2.1 time: 0.214633 Jun 16 16:19:20.560492 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 393/784] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:20 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1752 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:21.576671 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ca1961d6-7a78-4f1d-8038-b957507b092a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:21.577321 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ca1961d6-7a78-4f1d-8038-b957507b092a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:21.584411 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ca1961d6-7a78-4f1d-8038-b957507b092a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:21.584866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ca1961d6-7a78-4f1d-8038-b957507b092a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:21.585629 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ca1961d6-7a78-4f1d-8038-b957507b092a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:21.586108 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ca1961d6-7a78-4f1d-8038-b957507b092a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:21.727576 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ca1961d6-7a78-4f1d-8038-b957507b092a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:21.735964 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ca1961d6-7a78-4f1d-8038-b957507b092a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1757 microversion: 2.1 time: 0.163191 Jun 16 16:19:21.736526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 392/785] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:21 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:21.928837 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f8421e4c-b2b3-4f96-8ef9-543ab76c3d67 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:21.929865 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f8421e4c-b2b3-4f96-8ef9-543ab76c3d67 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:21.936246 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f8421e4c-b2b3-4f96-8ef9-543ab76c3d67 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:21.937271 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f8421e4c-b2b3-4f96-8ef9-543ab76c3d67 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:21.938056 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f8421e4c-b2b3-4f96-8ef9-543ab76c3d67 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:21.938484 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f8421e4c-b2b3-4f96-8ef9-543ab76c3d67 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:21.960132 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-f8421e4c-b2b3-4f96-8ef9-543ab76c3d67 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lazy-loading 'flavor' on Instance uuid 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:19:22.083524 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f8421e4c-b2b3-4f96-8ef9-543ab76c3d67 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "POST /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd/action" status: 200 len: 32 microversion: 2.1 time: 0.158497 Jun 16 16:19:22.084133 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 394/786] 10.222.0.88 () {60 vars in 1277 bytes} [Thu Jun 16 16:19:21 2022] POST /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:19:22.096176 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-130df7fc-fca5-4760-ac97-10277d276619 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:22.097411 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-130df7fc-fca5-4760-ac97-10277d276619 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:22.109371 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-130df7fc-fca5-4760-ac97-10277d276619 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:22.110425 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-130df7fc-fca5-4760-ac97-10277d276619 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:22.112438 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-130df7fc-fca5-4760-ac97-10277d276619 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:22.113105 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-130df7fc-fca5-4760-ac97-10277d276619 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:22.339950 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-130df7fc-fca5-4760-ac97-10277d276619 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:22.349159 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-130df7fc-fca5-4760-ac97-10277d276619 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1737 microversion: 2.1 time: 0.259770 Jun 16 16:19:22.349745 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 393/787] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:22 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1737 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:22.753405 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5f9fcdc6-31c1-4fbd-bb00-a6a0d598de6a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:22.754147 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5f9fcdc6-31c1-4fbd-bb00-a6a0d598de6a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:22.760313 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5f9fcdc6-31c1-4fbd-bb00-a6a0d598de6a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:22.760762 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5f9fcdc6-31c1-4fbd-bb00-a6a0d598de6a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:22.761512 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5f9fcdc6-31c1-4fbd-bb00-a6a0d598de6a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:22.762118 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5f9fcdc6-31c1-4fbd-bb00-a6a0d598de6a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:22.906260 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5f9fcdc6-31c1-4fbd-bb00-a6a0d598de6a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:22.914322 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5f9fcdc6-31c1-4fbd-bb00-a6a0d598de6a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1757 microversion: 2.1 time: 0.165627 Jun 16 16:19:22.914889 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 395/788] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:22 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:23.367016 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-64f21eb5-81c6-42f3-8d2d-7fbf4916eda7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:23.367629 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-64f21eb5-81c6-42f3-8d2d-7fbf4916eda7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:23.374931 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-64f21eb5-81c6-42f3-8d2d-7fbf4916eda7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:23.375381 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-64f21eb5-81c6-42f3-8d2d-7fbf4916eda7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:23.376155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-64f21eb5-81c6-42f3-8d2d-7fbf4916eda7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:23.376596 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-64f21eb5-81c6-42f3-8d2d-7fbf4916eda7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:23.505666 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-64f21eb5-81c6-42f3-8d2d-7fbf4916eda7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:23.513473 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-64f21eb5-81c6-42f3-8d2d-7fbf4916eda7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1737 microversion: 2.1 time: 0.150301 Jun 16 16:19:23.514065 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 394/789] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:23 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:23.931300 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2e08387a-b005-47da-bbb4-72f70c4d96d9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:23.931962 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2e08387a-b005-47da-bbb4-72f70c4d96d9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:23.938402 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2e08387a-b005-47da-bbb4-72f70c4d96d9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:23.938850 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2e08387a-b005-47da-bbb4-72f70c4d96d9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:23.939601 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2e08387a-b005-47da-bbb4-72f70c4d96d9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:23.940037 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2e08387a-b005-47da-bbb4-72f70c4d96d9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:24.082934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2e08387a-b005-47da-bbb4-72f70c4d96d9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:24.090813 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2e08387a-b005-47da-bbb4-72f70c4d96d9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1757 microversion: 2.1 time: 0.163379 Jun 16 16:19:24.091373 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 396/790] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:23 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:24.530681 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cfbca4ce-5456-46f3-86db-b606924843da tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:24.531284 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-cfbca4ce-5456-46f3-86db-b606924843da tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:24.537700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cfbca4ce-5456-46f3-86db-b606924843da tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:24.538170 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cfbca4ce-5456-46f3-86db-b606924843da tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:24.538919 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cfbca4ce-5456-46f3-86db-b606924843da tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:24.539351 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cfbca4ce-5456-46f3-86db-b606924843da tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:24.677450 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cfbca4ce-5456-46f3-86db-b606924843da tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:24.685962 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-cfbca4ce-5456-46f3-86db-b606924843da tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1737 microversion: 2.1 time: 0.159103 Jun 16 16:19:24.687071 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 395/791] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:24 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:25.108392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6cb2cae7-9978-4858-b1b2-c1eea9e2a2a8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:25.109580 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6cb2cae7-9978-4858-b1b2-c1eea9e2a2a8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:25.116541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6cb2cae7-9978-4858-b1b2-c1eea9e2a2a8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:25.116992 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6cb2cae7-9978-4858-b1b2-c1eea9e2a2a8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:25.117917 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6cb2cae7-9978-4858-b1b2-c1eea9e2a2a8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:25.118226 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6cb2cae7-9978-4858-b1b2-c1eea9e2a2a8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:25.268913 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6cb2cae7-9978-4858-b1b2-c1eea9e2a2a8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:25.277038 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6cb2cae7-9978-4858-b1b2-c1eea9e2a2a8 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1757 microversion: 2.1 time: 0.172501 Jun 16 16:19:25.277608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 397/792] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:25 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:25.348172 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-91ed4e36-c076-4827-89a8-5dbc22cb6e49 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:25.348702 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-91ed4e36-c076-4827-89a8-5dbc22cb6e49 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:25.354711 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-91ed4e36-c076-4827-89a8-5dbc22cb6e49 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:25.355177 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-91ed4e36-c076-4827-89a8-5dbc22cb6e49 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:25.355923 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-91ed4e36-c076-4827-89a8-5dbc22cb6e49 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:25.356350 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-91ed4e36-c076-4827-89a8-5dbc22cb6e49 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:25.537420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-91ed4e36-c076-4827-89a8-5dbc22cb6e49 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lazy-loading 'flavor' on Instance uuid c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:19:25.659959 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-91ed4e36-c076-4827-89a8-5dbc22cb6e49 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "POST /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4/action" status: 202 len: 0 microversion: 2.1 time: 0.420593 Jun 16 16:19:25.660550 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 396/793] 10.222.0.88 () {60 vars in 1277 bytes} [Thu Jun 16 16:19:25 2022] POST /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:19:25.668853 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-58cfc8ba-26d3-42b8-a8b4-6c7619c00528 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:25.670211 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-58cfc8ba-26d3-42b8-a8b4-6c7619c00528 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:25.677207 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-58cfc8ba-26d3-42b8-a8b4-6c7619c00528 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:25.677654 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-58cfc8ba-26d3-42b8-a8b4-6c7619c00528 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:25.678479 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-58cfc8ba-26d3-42b8-a8b4-6c7619c00528 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:25.678915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-58cfc8ba-26d3-42b8-a8b4-6c7619c00528 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:25.703584 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-61444d7e-2182-44da-b5ed-183cda70133e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:25.704359 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-61444d7e-2182-44da-b5ed-183cda70133e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:25.710512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61444d7e-2182-44da-b5ed-183cda70133e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:25.711037 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61444d7e-2182-44da-b5ed-183cda70133e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:25.711718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61444d7e-2182-44da-b5ed-183cda70133e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:25.712145 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61444d7e-2182-44da-b5ed-183cda70133e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:25.871618 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-58cfc8ba-26d3-42b8-a8b4-6c7619c00528 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:25.879946 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-58cfc8ba-26d3-42b8-a8b4-6c7619c00528 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1566 microversion: 2.1 time: 0.214978 Jun 16 16:19:25.880527 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 398/794] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:25 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1566 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:25.894236 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-61444d7e-2182-44da-b5ed-183cda70133e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:25.902178 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-61444d7e-2182-44da-b5ed-183cda70133e tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1737 microversion: 2.1 time: 0.202813 Jun 16 16:19:25.902724 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 397/795] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:25 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1737 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:26.294705 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-395a68da-8050-450d-a2f7-630608a1d471 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:26.295313 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-395a68da-8050-450d-a2f7-630608a1d471 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:26.301864 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-395a68da-8050-450d-a2f7-630608a1d471 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:26.302310 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-395a68da-8050-450d-a2f7-630608a1d471 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:26.303061 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-395a68da-8050-450d-a2f7-630608a1d471 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:26.303495 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-395a68da-8050-450d-a2f7-630608a1d471 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:26.443962 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-395a68da-8050-450d-a2f7-630608a1d471 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:26.451831 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-395a68da-8050-450d-a2f7-630608a1d471 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1757 microversion: 2.1 time: 0.160950 Jun 16 16:19:26.452386 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 399/796] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:26 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:26.896741 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-914eb190-a8f4-4fba-8860-973094e8d844 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:26.897361 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-914eb190-a8f4-4fba-8860-973094e8d844 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:26.903850 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-914eb190-a8f4-4fba-8860-973094e8d844 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:26.904297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-914eb190-a8f4-4fba-8860-973094e8d844 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:26.905062 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-914eb190-a8f4-4fba-8860-973094e8d844 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:26.906098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-914eb190-a8f4-4fba-8860-973094e8d844 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:26.920046 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-81958b0b-c562-4e18-9489-ed4893ce7e03 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:26.920681 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-81958b0b-c562-4e18-9489-ed4893ce7e03 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:26.926421 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-81958b0b-c562-4e18-9489-ed4893ce7e03 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:26.926865 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-81958b0b-c562-4e18-9489-ed4893ce7e03 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:26.927622 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-81958b0b-c562-4e18-9489-ed4893ce7e03 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:26.928050 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-81958b0b-c562-4e18-9489-ed4893ce7e03 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:27.106322 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-914eb190-a8f4-4fba-8860-973094e8d844 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:27.110739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-81958b0b-c562-4e18-9489-ed4893ce7e03 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:27.114049 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-914eb190-a8f4-4fba-8860-973094e8d844 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1566 microversion: 2.1 time: 0.221102 Jun 16 16:19:27.114642 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 398/797] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:26 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1566 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:27.120745 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-81958b0b-c562-4e18-9489-ed4893ce7e03 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1737 microversion: 2.1 time: 0.204987 Jun 16 16:19:27.121445 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 400/798] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:26 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:27.469295 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-588a45df-3c03-4db7-ab22-4a27082c9eb4 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:27.469943 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-588a45df-3c03-4db7-ab22-4a27082c9eb4 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:27.476245 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-588a45df-3c03-4db7-ab22-4a27082c9eb4 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:27.476691 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-588a45df-3c03-4db7-ab22-4a27082c9eb4 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:27.477445 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-588a45df-3c03-4db7-ab22-4a27082c9eb4 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:27.477913 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-588a45df-3c03-4db7-ab22-4a27082c9eb4 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:27.624220 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-588a45df-3c03-4db7-ab22-4a27082c9eb4 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:27.632163 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-588a45df-3c03-4db7-ab22-4a27082c9eb4 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1757 microversion: 2.1 time: 0.167305 Jun 16 16:19:27.632710 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 399/799] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:27 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:28.132535 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-abda6721-4145-45ca-be8b-4d3909ea2903 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:28.133282 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-abda6721-4145-45ca-be8b-4d3909ea2903 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:28.138587 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1f8f908b-14e9-4a88-84a4-7204f8523d8c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:28.139212 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1f8f908b-14e9-4a88-84a4-7204f8523d8c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:28.140678 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-abda6721-4145-45ca-be8b-4d3909ea2903 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:28.141125 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-abda6721-4145-45ca-be8b-4d3909ea2903 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:28.141928 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-abda6721-4145-45ca-be8b-4d3909ea2903 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:28.142696 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-abda6721-4145-45ca-be8b-4d3909ea2903 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:28.146022 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1f8f908b-14e9-4a88-84a4-7204f8523d8c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:28.146474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1f8f908b-14e9-4a88-84a4-7204f8523d8c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:28.147278 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1f8f908b-14e9-4a88-84a4-7204f8523d8c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:28.147711 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1f8f908b-14e9-4a88-84a4-7204f8523d8c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:28.341227 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-abda6721-4145-45ca-be8b-4d3909ea2903 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:28.345352 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1f8f908b-14e9-4a88-84a4-7204f8523d8c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:28.350575 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-abda6721-4145-45ca-be8b-4d3909ea2903 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1566 microversion: 2.1 time: 0.222651 Jun 16 16:19:28.351337 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 401/800] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:28 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1566 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:28.355002 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1f8f908b-14e9-4a88-84a4-7204f8523d8c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1737 microversion: 2.1 time: 0.220295 Jun 16 16:19:28.355558 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 400/801] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:28 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:28.650517 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7064dd17-fb1b-4c66-9164-bb59818eceff tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:28.651127 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7064dd17-fb1b-4c66-9164-bb59818eceff tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:28.657645 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7064dd17-fb1b-4c66-9164-bb59818eceff tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:28.658123 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7064dd17-fb1b-4c66-9164-bb59818eceff tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:28.658880 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7064dd17-fb1b-4c66-9164-bb59818eceff tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:28.659317 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7064dd17-fb1b-4c66-9164-bb59818eceff tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:28.801035 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7064dd17-fb1b-4c66-9164-bb59818eceff tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:28.809086 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7064dd17-fb1b-4c66-9164-bb59818eceff tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1757 microversion: 2.1 time: 0.162452 Jun 16 16:19:28.809645 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 402/802] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:28 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:29.373831 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9478fc5f-5c24-4144-bef8-eaa41f150bdc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:29.374443 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9478fc5f-5c24-4144-bef8-eaa41f150bdc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:29.376252 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e42c824b-dc85-4d40-8fff-5c9061bd3641 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:29.376898 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e42c824b-dc85-4d40-8fff-5c9061bd3641 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:29.380947 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9478fc5f-5c24-4144-bef8-eaa41f150bdc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:29.381389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9478fc5f-5c24-4144-bef8-eaa41f150bdc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:29.382178 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9478fc5f-5c24-4144-bef8-eaa41f150bdc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:29.382668 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9478fc5f-5c24-4144-bef8-eaa41f150bdc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:29.383368 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e42c824b-dc85-4d40-8fff-5c9061bd3641 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:29.383818 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e42c824b-dc85-4d40-8fff-5c9061bd3641 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:29.384607 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e42c824b-dc85-4d40-8fff-5c9061bd3641 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:29.385050 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e42c824b-dc85-4d40-8fff-5c9061bd3641 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:29.582482 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9478fc5f-5c24-4144-bef8-eaa41f150bdc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:29.585262 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e42c824b-dc85-4d40-8fff-5c9061bd3641 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:29.590607 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9478fc5f-5c24-4144-bef8-eaa41f150bdc tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1566 microversion: 2.1 time: 0.220996 Jun 16 16:19:29.591181 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 401/803] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:29 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1566 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:29.593855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e42c824b-dc85-4d40-8fff-5c9061bd3641 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1737 microversion: 2.1 time: 0.221457 Jun 16 16:19:29.594424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 403/804] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:29 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:29.826953 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d04f7bc8-a01e-4600-996a-51a640bc8892 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:29.828056 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d04f7bc8-a01e-4600-996a-51a640bc8892 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:29.834044 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d04f7bc8-a01e-4600-996a-51a640bc8892 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:29.834500 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d04f7bc8-a01e-4600-996a-51a640bc8892 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:29.835269 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d04f7bc8-a01e-4600-996a-51a640bc8892 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:29.835710 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d04f7bc8-a01e-4600-996a-51a640bc8892 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:29.975361 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d04f7bc8-a01e-4600-996a-51a640bc8892 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:29.983874 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d04f7bc8-a01e-4600-996a-51a640bc8892 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1757 microversion: 2.1 time: 0.160311 Jun 16 16:19:29.984422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 402/805] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:29 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:30.609119 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b26afe14-a6b1-426f-96cb-36cd1b580ed7 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:30.609873 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b26afe14-a6b1-426f-96cb-36cd1b580ed7 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:30.612186 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-80e35a88-3d24-450e-8965-cff94f2e74ef tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:30.612802 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-80e35a88-3d24-450e-8965-cff94f2e74ef tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:30.621617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b26afe14-a6b1-426f-96cb-36cd1b580ed7 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:30.621617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b26afe14-a6b1-426f-96cb-36cd1b580ed7 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:30.622537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-80e35a88-3d24-450e-8965-cff94f2e74ef tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:30.622537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-80e35a88-3d24-450e-8965-cff94f2e74ef tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:30.622537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-80e35a88-3d24-450e-8965-cff94f2e74ef tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:30.622980 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b26afe14-a6b1-426f-96cb-36cd1b580ed7 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:30.623126 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-80e35a88-3d24-450e-8965-cff94f2e74ef tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:30.623301 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b26afe14-a6b1-426f-96cb-36cd1b580ed7 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:30.627659 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:30.850536 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b26afe14-a6b1-426f-96cb-36cd1b580ed7 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:30.857666 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-80e35a88-3d24-450e-8965-cff94f2e74ef tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:30.858785 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b26afe14-a6b1-426f-96cb-36cd1b580ed7 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1566 microversion: 2.1 time: 0.253975 Jun 16 16:19:30.859355 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 404/806] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:30 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1566 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:30.866222 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-80e35a88-3d24-450e-8965-cff94f2e74ef tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1737 microversion: 2.1 time: 0.259401 Jun 16 16:19:30.866777 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 403/807] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:30 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1737 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:31.001169 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c124cf60-5647-4e5a-98d8-af4f6077c62c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:31.001797 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c124cf60-5647-4e5a-98d8-af4f6077c62c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:31.007750 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c124cf60-5647-4e5a-98d8-af4f6077c62c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:31.008191 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c124cf60-5647-4e5a-98d8-af4f6077c62c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:31.008939 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c124cf60-5647-4e5a-98d8-af4f6077c62c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:31.009370 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c124cf60-5647-4e5a-98d8-af4f6077c62c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:31.027010 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:31.163977 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c124cf60-5647-4e5a-98d8-af4f6077c62c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:31.172528 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c124cf60-5647-4e5a-98d8-af4f6077c62c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1757 microversion: 2.1 time: 0.176084 Jun 16 16:19:31.173096 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 405/808] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:30 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:31.876135 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9f4e4f84-c4d0-491f-8192-803e1bc9e282 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:31.876738 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9f4e4f84-c4d0-491f-8192-803e1bc9e282 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:31.883245 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9f4e4f84-c4d0-491f-8192-803e1bc9e282 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:31.883683 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a6aa5e97-6d21-438b-a671-f21cf6734504 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:31.884107 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9f4e4f84-c4d0-491f-8192-803e1bc9e282 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:31.884300 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a6aa5e97-6d21-438b-a671-f21cf6734504 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:31.884439 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9f4e4f84-c4d0-491f-8192-803e1bc9e282 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:31.884920 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9f4e4f84-c4d0-491f-8192-803e1bc9e282 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:31.891232 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a6aa5e97-6d21-438b-a671-f21cf6734504 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:31.891681 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a6aa5e97-6d21-438b-a671-f21cf6734504 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:31.892458 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a6aa5e97-6d21-438b-a671-f21cf6734504 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:31.892895 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a6aa5e97-6d21-438b-a671-f21cf6734504 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:32.085438 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9f4e4f84-c4d0-491f-8192-803e1bc9e282 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:32.089366 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a6aa5e97-6d21-438b-a671-f21cf6734504 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:32.094308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9f4e4f84-c4d0-491f-8192-803e1bc9e282 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1566 microversion: 2.1 time: 0.222503 Jun 16 16:19:32.094892 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 404/809] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:31 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1566 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:32.098321 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a6aa5e97-6d21-438b-a671-f21cf6734504 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1737 microversion: 2.1 time: 0.218287 Jun 16 16:19:32.098880 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 406/810] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:31 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:32.189647 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2ae377cd-4c0a-4200-a43f-c58da3bb3990 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:32.190288 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2ae377cd-4c0a-4200-a43f-c58da3bb3990 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:32.196276 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2ae377cd-4c0a-4200-a43f-c58da3bb3990 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:32.196721 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2ae377cd-4c0a-4200-a43f-c58da3bb3990 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:32.197481 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2ae377cd-4c0a-4200-a43f-c58da3bb3990 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:32.197952 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2ae377cd-4c0a-4200-a43f-c58da3bb3990 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:32.336866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2ae377cd-4c0a-4200-a43f-c58da3bb3990 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:32.345695 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2ae377cd-4c0a-4200-a43f-c58da3bb3990 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1757 microversion: 2.1 time: 0.159939 Jun 16 16:19:32.346290 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 405/811] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:32 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:33.113225 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-45f63feb-9526-424d-901a-bc249278117f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:33.113852 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-45f63feb-9526-424d-901a-bc249278117f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:33.115176 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-42d53027-c87d-49e8-8efd-d258f72d7f32 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:33.115796 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-42d53027-c87d-49e8-8efd-d258f72d7f32 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:33.120466 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-45f63feb-9526-424d-901a-bc249278117f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:33.120911 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-45f63feb-9526-424d-901a-bc249278117f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:33.121660 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-45f63feb-9526-424d-901a-bc249278117f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:33.122112 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-45f63feb-9526-424d-901a-bc249278117f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:33.122371 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-42d53027-c87d-49e8-8efd-d258f72d7f32 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:33.122828 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-42d53027-c87d-49e8-8efd-d258f72d7f32 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:33.123602 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-42d53027-c87d-49e8-8efd-d258f72d7f32 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:33.124609 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-42d53027-c87d-49e8-8efd-d258f72d7f32 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:33.315684 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-42d53027-c87d-49e8-8efd-d258f72d7f32 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:33.323645 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-42d53027-c87d-49e8-8efd-d258f72d7f32 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1737 microversion: 2.1 time: 0.212208 Jun 16 16:19:33.328549 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 406/812] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:33 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:33.328873 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-45f63feb-9526-424d-901a-bc249278117f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:33.336320 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-45f63feb-9526-424d-901a-bc249278117f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1566 microversion: 2.1 time: 0.228063 Jun 16 16:19:33.336865 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 407/813] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:33 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1566 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:33.363596 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ccd84611-4ae3-4ad1-8e38-b63caf6961cb tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:33.364134 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ccd84611-4ae3-4ad1-8e38-b63caf6961cb tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:33.370330 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ccd84611-4ae3-4ad1-8e38-b63caf6961cb tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:33.370798 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ccd84611-4ae3-4ad1-8e38-b63caf6961cb tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:33.371553 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ccd84611-4ae3-4ad1-8e38-b63caf6961cb tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:33.371981 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ccd84611-4ae3-4ad1-8e38-b63caf6961cb tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:33.510536 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ccd84611-4ae3-4ad1-8e38-b63caf6961cb tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:33.518641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ccd84611-4ae3-4ad1-8e38-b63caf6961cb tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1757 microversion: 2.1 time: 0.158890 Jun 16 16:19:33.519198 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 407/814] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:33 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:34.341540 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6beb20cc-5817-4c62-a486-88612e5dafea tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:34.342292 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6beb20cc-5817-4c62-a486-88612e5dafea tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:34.350068 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6beb20cc-5817-4c62-a486-88612e5dafea tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:34.350539 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6beb20cc-5817-4c62-a486-88612e5dafea tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:34.351306 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6beb20cc-5817-4c62-a486-88612e5dafea tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:34.351747 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6beb20cc-5817-4c62-a486-88612e5dafea tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:34.353404 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4a72310b-eaff-4258-a4bb-bef1c35b7fea tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:34.354872 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4a72310b-eaff-4258-a4bb-bef1c35b7fea tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:34.363012 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4a72310b-eaff-4258-a4bb-bef1c35b7fea tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:34.363380 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4a72310b-eaff-4258-a4bb-bef1c35b7fea tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:34.364207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4a72310b-eaff-4258-a4bb-bef1c35b7fea tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:34.364635 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4a72310b-eaff-4258-a4bb-bef1c35b7fea tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:34.874252 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6beb20cc-5817-4c62-a486-88612e5dafea tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:34.882256 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6beb20cc-5817-4c62-a486-88612e5dafea tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1737 microversion: 2.1 time: 0.544651 Jun 16 16:19:34.882838 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 408/815] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:34 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1737 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:34.887431 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9d31ecd7-9a20-4016-801c-e84f939a9cd1 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:34.888039 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9d31ecd7-9a20-4016-801c-e84f939a9cd1 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:34.894737 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d31ecd7-9a20-4016-801c-e84f939a9cd1 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:34.895189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d31ecd7-9a20-4016-801c-e84f939a9cd1 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:34.895962 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d31ecd7-9a20-4016-801c-e84f939a9cd1 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:34.896401 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d31ecd7-9a20-4016-801c-e84f939a9cd1 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:34.898226 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4a72310b-eaff-4258-a4bb-bef1c35b7fea tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:34.905857 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4a72310b-eaff-4258-a4bb-bef1c35b7fea tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1566 microversion: 2.1 time: 0.556998 Jun 16 16:19:34.906428 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 408/816] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:34 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1566 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:35.134897 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9d31ecd7-9a20-4016-801c-e84f939a9cd1 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:35.144916 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9d31ecd7-9a20-4016-801c-e84f939a9cd1 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1757 microversion: 2.1 time: 0.261028 Jun 16 16:19:35.145492 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 409/817] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:34 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1757 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:35.899924 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6c45973c-40b7-4dc1-a46d-475bcc0f75db tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:35.900534 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6c45973c-40b7-4dc1-a46d-475bcc0f75db tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:35.907603 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6c45973c-40b7-4dc1-a46d-475bcc0f75db tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:35.908054 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6c45973c-40b7-4dc1-a46d-475bcc0f75db tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:35.908827 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6c45973c-40b7-4dc1-a46d-475bcc0f75db tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:35.909262 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6c45973c-40b7-4dc1-a46d-475bcc0f75db tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:35.922215 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-90614d90-546d-43de-9c11-d3ec9bb8a0f1 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:35.922905 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-90614d90-546d-43de-9c11-d3ec9bb8a0f1 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:35.929591 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-90614d90-546d-43de-9c11-d3ec9bb8a0f1 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:35.930064 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-90614d90-546d-43de-9c11-d3ec9bb8a0f1 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:35.930809 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-90614d90-546d-43de-9c11-d3ec9bb8a0f1 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:35.931248 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-90614d90-546d-43de-9c11-d3ec9bb8a0f1 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:36.100858 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6c45973c-40b7-4dc1-a46d-475bcc0f75db tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:36.108946 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6c45973c-40b7-4dc1-a46d-475bcc0f75db tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1737 microversion: 2.1 time: 0.212816 Jun 16 16:19:36.109527 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 409/818] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:35 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:36.121585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-90614d90-546d-43de-9c11-d3ec9bb8a0f1 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:36.129596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-90614d90-546d-43de-9c11-d3ec9bb8a0f1 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1566 microversion: 2.1 time: 0.211268 Jun 16 16:19:36.130185 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 410/819] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:35 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1566 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:36.162245 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-16d577bf-ad59-4dcf-81ea-78b26a41797f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:36.162847 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-16d577bf-ad59-4dcf-81ea-78b26a41797f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:36.168743 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-16d577bf-ad59-4dcf-81ea-78b26a41797f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:36.169180 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-16d577bf-ad59-4dcf-81ea-78b26a41797f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:36.169959 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-16d577bf-ad59-4dcf-81ea-78b26a41797f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:36.170418 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-16d577bf-ad59-4dcf-81ea-78b26a41797f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:36.420639 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-16d577bf-ad59-4dcf-81ea-78b26a41797f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:36.429084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-16d577bf-ad59-4dcf-81ea-78b26a41797f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1757 microversion: 2.1 time: 0.270727 Jun 16 16:19:36.429657 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 410/820] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:36 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1757 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:37.125391 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3b468ee0-0957-49e9-b8e6-7f90a7d56cea tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:37.126029 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3b468ee0-0957-49e9-b8e6-7f90a7d56cea tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:37.132940 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3b468ee0-0957-49e9-b8e6-7f90a7d56cea tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:37.133383 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3b468ee0-0957-49e9-b8e6-7f90a7d56cea tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:37.134164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3b468ee0-0957-49e9-b8e6-7f90a7d56cea tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:37.134609 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3b468ee0-0957-49e9-b8e6-7f90a7d56cea tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:37.146186 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4d365699-91c0-4c9b-a263-c83fd6789278 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:37.146785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4d365699-91c0-4c9b-a263-c83fd6789278 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:37.153407 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4d365699-91c0-4c9b-a263-c83fd6789278 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:37.153891 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4d365699-91c0-4c9b-a263-c83fd6789278 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:37.154654 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4d365699-91c0-4c9b-a263-c83fd6789278 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:37.155579 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4d365699-91c0-4c9b-a263-c83fd6789278 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:37.330438 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3b468ee0-0957-49e9-b8e6-7f90a7d56cea tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:37.338371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3b468ee0-0957-49e9-b8e6-7f90a7d56cea tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1737 microversion: 2.1 time: 0.216982 Jun 16 16:19:37.339023 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 411/821] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:37 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:37.339622 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4d365699-91c0-4c9b-a263-c83fd6789278 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:37.348061 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4d365699-91c0-4c9b-a263-c83fd6789278 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1566 microversion: 2.1 time: 0.205399 Jun 16 16:19:37.348701 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 411/822] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:37 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1566 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:37.446561 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-60e4bc5e-7f84-46f1-bfc4-8d04696054e7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:37.447081 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-60e4bc5e-7f84-46f1-bfc4-8d04696054e7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:37.453502 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-60e4bc5e-7f84-46f1-bfc4-8d04696054e7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:37.453968 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-60e4bc5e-7f84-46f1-bfc4-8d04696054e7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:37.454722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-60e4bc5e-7f84-46f1-bfc4-8d04696054e7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:37.455153 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-60e4bc5e-7f84-46f1-bfc4-8d04696054e7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:37.599469 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-60e4bc5e-7f84-46f1-bfc4-8d04696054e7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:37.607395 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-60e4bc5e-7f84-46f1-bfc4-8d04696054e7 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1757 microversion: 2.1 time: 0.164744 Jun 16 16:19:37.607960 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 412/823] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:37 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:38.356478 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-31a89e37-9ebd-42a4-ba45-66ed91a8a01b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:38.357080 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-31a89e37-9ebd-42a4-ba45-66ed91a8a01b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:38.363777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-13aa782e-ac13-4bda-a1de-0e1a48ba409b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:38.364259 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-31a89e37-9ebd-42a4-ba45-66ed91a8a01b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:38.364259 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-31a89e37-9ebd-42a4-ba45-66ed91a8a01b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:38.364444 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-13aa782e-ac13-4bda-a1de-0e1a48ba409b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:38.365028 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-31a89e37-9ebd-42a4-ba45-66ed91a8a01b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:38.365584 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-31a89e37-9ebd-42a4-ba45-66ed91a8a01b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:38.371475 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-13aa782e-ac13-4bda-a1de-0e1a48ba409b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:38.371929 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-13aa782e-ac13-4bda-a1de-0e1a48ba409b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:38.372712 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-13aa782e-ac13-4bda-a1de-0e1a48ba409b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:38.373172 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-13aa782e-ac13-4bda-a1de-0e1a48ba409b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:38.572851 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-13aa782e-ac13-4bda-a1de-0e1a48ba409b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:38.577332 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-31a89e37-9ebd-42a4-ba45-66ed91a8a01b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:38.581461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-13aa782e-ac13-4bda-a1de-0e1a48ba409b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1566 microversion: 2.1 time: 0.221395 Jun 16 16:19:38.582238 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 413/824] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:38 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1566 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:38.585265 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-31a89e37-9ebd-42a4-ba45-66ed91a8a01b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1737 microversion: 2.1 time: 0.232717 Jun 16 16:19:38.585832 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 412/825] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:38 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1737 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:38.625054 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-eb7c2371-2ace-44cc-a9fc-2a5cbe7f988c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:38.626132 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-eb7c2371-2ace-44cc-a9fc-2a5cbe7f988c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:38.631972 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb7c2371-2ace-44cc-a9fc-2a5cbe7f988c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:38.632418 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb7c2371-2ace-44cc-a9fc-2a5cbe7f988c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:38.633301 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb7c2371-2ace-44cc-a9fc-2a5cbe7f988c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:38.633823 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb7c2371-2ace-44cc-a9fc-2a5cbe7f988c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:38.776203 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-eb7c2371-2ace-44cc-a9fc-2a5cbe7f988c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:38.784225 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-eb7c2371-2ace-44cc-a9fc-2a5cbe7f988c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1760 microversion: 2.1 time: 0.163859 Jun 16 16:19:38.784785 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 414/826] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:38 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1760 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:39.598787 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-991a2e66-57ea-4d0c-a541-7ac6a82d853b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:39.599425 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-991a2e66-57ea-4d0c-a541-7ac6a82d853b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:39.602418 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c2730d8a-2e07-4ff1-b95e-7f2d749ae3f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:39.603034 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c2730d8a-2e07-4ff1-b95e-7f2d749ae3f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:39.605980 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-991a2e66-57ea-4d0c-a541-7ac6a82d853b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:39.606425 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-991a2e66-57ea-4d0c-a541-7ac6a82d853b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:39.607193 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-991a2e66-57ea-4d0c-a541-7ac6a82d853b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:39.607629 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-991a2e66-57ea-4d0c-a541-7ac6a82d853b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:39.610126 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c2730d8a-2e07-4ff1-b95e-7f2d749ae3f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:39.610755 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c2730d8a-2e07-4ff1-b95e-7f2d749ae3f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:39.611525 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c2730d8a-2e07-4ff1-b95e-7f2d749ae3f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:39.611964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c2730d8a-2e07-4ff1-b95e-7f2d749ae3f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:39.816874 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-991a2e66-57ea-4d0c-a541-7ac6a82d853b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:39.819759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c2730d8a-2e07-4ff1-b95e-7f2d749ae3f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:39.824600 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-991a2e66-57ea-4d0c-a541-7ac6a82d853b tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1566 microversion: 2.1 time: 0.229883 Jun 16 16:19:39.825171 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 413/827] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:39 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1566 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:39.828976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c2730d8a-2e07-4ff1-b95e-7f2d749ae3f7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1737 microversion: 2.1 time: 0.230316 Jun 16 16:19:39.829554 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 415/828] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:39 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1737 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:40.842037 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8a84b8de-536b-4af1-9af8-b8496007634f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:40.842740 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8a84b8de-536b-4af1-9af8-b8496007634f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:40.845777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-08f5bda5-5f58-435d-9a0e-9e60a78eec83 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:40.846417 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-08f5bda5-5f58-435d-9a0e-9e60a78eec83 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:40.849623 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8a84b8de-536b-4af1-9af8-b8496007634f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:40.850099 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8a84b8de-536b-4af1-9af8-b8496007634f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:40.850867 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8a84b8de-536b-4af1-9af8-b8496007634f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:40.851304 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8a84b8de-536b-4af1-9af8-b8496007634f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:40.852977 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-08f5bda5-5f58-435d-9a0e-9e60a78eec83 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:40.853529 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-08f5bda5-5f58-435d-9a0e-9e60a78eec83 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:40.854335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-08f5bda5-5f58-435d-9a0e-9e60a78eec83 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:40.854769 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-08f5bda5-5f58-435d-9a0e-9e60a78eec83 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:41.050321 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8a84b8de-536b-4af1-9af8-b8496007634f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:41.052876 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-08f5bda5-5f58-435d-9a0e-9e60a78eec83 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:41.058089 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8a84b8de-536b-4af1-9af8-b8496007634f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1566 microversion: 2.1 time: 0.219896 Jun 16 16:19:41.058657 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 414/829] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:40 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1566 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:41.060770 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-08f5bda5-5f58-435d-9a0e-9e60a78eec83 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1737 microversion: 2.1 time: 0.218810 Jun 16 16:19:41.061906 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 416/830] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:40 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:42.076336 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d004a225-8864-401a-81f8-022fa81abb00 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:42.076983 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d004a225-8864-401a-81f8-022fa81abb00 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:42.078132 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d8089c5a-1f32-47ae-8898-da03c3fafe38 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:42.078750 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d8089c5a-1f32-47ae-8898-da03c3fafe38 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:42.083594 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d004a225-8864-401a-81f8-022fa81abb00 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:42.084041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d004a225-8864-401a-81f8-022fa81abb00 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:42.084799 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d004a225-8864-401a-81f8-022fa81abb00 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:42.085231 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d004a225-8864-401a-81f8-022fa81abb00 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:42.085523 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d8089c5a-1f32-47ae-8898-da03c3fafe38 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:42.086003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d8089c5a-1f32-47ae-8898-da03c3fafe38 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:42.086795 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d8089c5a-1f32-47ae-8898-da03c3fafe38 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:42.087258 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d8089c5a-1f32-47ae-8898-da03c3fafe38 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:42.279397 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d004a225-8864-401a-81f8-022fa81abb00 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:42.284147 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d8089c5a-1f32-47ae-8898-da03c3fafe38 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:42.287696 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d004a225-8864-401a-81f8-022fa81abb00 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1507 microversion: 2.1 time: 0.215594 Jun 16 16:19:42.288511 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 415/831] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:42 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:42.292006 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d8089c5a-1f32-47ae-8898-da03c3fafe38 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1737 microversion: 2.1 time: 0.217743 Jun 16 16:19:42.293141 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 417/832] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:42 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:42.305227 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f855160d-a1c9-4d83-8d4a-cad02499cf8c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:42.305844 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f855160d-a1c9-4d83-8d4a-cad02499cf8c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:42.311874 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f855160d-a1c9-4d83-8d4a-cad02499cf8c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:42.312327 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f855160d-a1c9-4d83-8d4a-cad02499cf8c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:42.313095 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f855160d-a1c9-4d83-8d4a-cad02499cf8c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:42.313536 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f855160d-a1c9-4d83-8d4a-cad02499cf8c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:42.389002 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f855160d-a1c9-4d83-8d4a-cad02499cf8c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "POST /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4/action" status: 202 len: 0 microversion: 2.1 time: 0.087578 Jun 16 16:19:42.389541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 416/833] 10.222.0.88 () {60 vars in 1277 bytes} [Thu Jun 16 16:19:42 2022] POST /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:19:42.398870 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8973dea7-27c2-4885-854a-095ed112c2ae tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:42.400108 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8973dea7-27c2-4885-854a-095ed112c2ae tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:42.406258 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8973dea7-27c2-4885-854a-095ed112c2ae tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:42.406791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8973dea7-27c2-4885-854a-095ed112c2ae tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:42.407646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8973dea7-27c2-4885-854a-095ed112c2ae tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:42.408144 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8973dea7-27c2-4885-854a-095ed112c2ae tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:42.552244 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8973dea7-27c2-4885-854a-095ed112c2ae tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:42.559706 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8973dea7-27c2-4885-854a-095ed112c2ae tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1515 microversion: 2.1 time: 0.164894 Jun 16 16:19:42.560584 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 418/834] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:42 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:42.587332 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-4f6f7759-f839-496d-86ac-65f6be31094d req-458eb67f-e1c7-463b-8168-4591bcb67555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c92e5c48-0ac8-4a24-9e6b-019b7825b0b4", "name": "network-vif-unplugged", "status": "completed", "tag": "fd0e55d6-c023-4540-8b9f-28e600c52b4f"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:42.597527 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-4f6f7759-f839-496d-86ac-65f6be31094d req-458eb67f-e1c7-463b-8168-4591bcb67555 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:42.598261 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-4f6f7759-f839-496d-86ac-65f6be31094d req-458eb67f-e1c7-463b-8168-4591bcb67555 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:42.613870 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.compute.server_external_events [req-4f6f7759-f839-496d-86ac-65f6be31094d req-458eb67f-e1c7-463b-8168-4591bcb67555 service nova] Unable to find a host for instance c92e5c48-0ac8-4a24-9e6b-019b7825b0b4. Dropping event network-vif-unplugged {{(pid=117712) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 16:19:42.614813 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-4f6f7759-f839-496d-86ac-65f6be31094d req-458eb67f-e1c7-463b-8168-4591bcb67555 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032752 Jun 16 16:19:42.615579 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 417/835] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 16:19:43.310317 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-11aa70f0-f65c-4149-8c23-cd52acf4a6da tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:43.310936 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-11aa70f0-f65c-4149-8c23-cd52acf4a6da tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:43.317436 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-11aa70f0-f65c-4149-8c23-cd52acf4a6da tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:43.317929 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-11aa70f0-f65c-4149-8c23-cd52acf4a6da tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:43.318693 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-11aa70f0-f65c-4149-8c23-cd52acf4a6da tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:43.319129 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-11aa70f0-f65c-4149-8c23-cd52acf4a6da tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:43.453644 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-11aa70f0-f65c-4149-8c23-cd52acf4a6da tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:43.461969 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-11aa70f0-f65c-4149-8c23-cd52acf4a6da tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1737 microversion: 2.1 time: 0.156250 Jun 16 16:19:43.462682 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 419/836] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:43 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:43.576978 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-dce654e2-ed7c-4b3d-b1cb-dff5306be3ac tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:43.577513 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dce654e2-ed7c-4b3d-b1cb-dff5306be3ac tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:43.579963 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=59 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:43.585927 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dce654e2-ed7c-4b3d-b1cb-dff5306be3ac tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:43.586389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dce654e2-ed7c-4b3d-b1cb-dff5306be3ac tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:43.587164 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dce654e2-ed7c-4b3d-b1cb-dff5306be3ac tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:43.587603 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dce654e2-ed7c-4b3d-b1cb-dff5306be3ac tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:43.722869 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dce654e2-ed7c-4b3d-b1cb-dff5306be3ac tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:43.730456 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-dce654e2-ed7c-4b3d-b1cb-dff5306be3ac tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1517 microversion: 2.1 time: 0.157898 Jun 16 16:19:43.731017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 418/837] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:43 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:44.479451 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-499956c3-bbde-4408-bc37-d604e15d18e4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:44.480053 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-499956c3-bbde-4408-bc37-d604e15d18e4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:44.486551 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-499956c3-bbde-4408-bc37-d604e15d18e4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:44.486995 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-499956c3-bbde-4408-bc37-d604e15d18e4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:44.487740 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-499956c3-bbde-4408-bc37-d604e15d18e4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:44.488171 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-499956c3-bbde-4408-bc37-d604e15d18e4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:44.626457 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-499956c3-bbde-4408-bc37-d604e15d18e4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:44.634603 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-499956c3-bbde-4408-bc37-d604e15d18e4 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1717 microversion: 2.1 time: 0.158937 Jun 16 16:19:44.645999 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 420/838] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:44 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1717 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:44.691362 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-437b968e-ec56-4d0e-99e2-9e87ceac7738 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:44.692558 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-437b968e-ec56-4d0e-99e2-9e87ceac7738 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:44.699251 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-437b968e-ec56-4d0e-99e2-9e87ceac7738 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:44.699702 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-437b968e-ec56-4d0e-99e2-9e87ceac7738 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:44.700473 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-437b968e-ec56-4d0e-99e2-9e87ceac7738 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:44.700915 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-437b968e-ec56-4d0e-99e2-9e87ceac7738 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:44.718982 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:44.746430 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d200b30e-3a3e-4fd5-bec6-bff9f49e6229 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:44.747034 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d200b30e-3a3e-4fd5-bec6-bff9f49e6229 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:44.753473 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d200b30e-3a3e-4fd5-bec6-bff9f49e6229 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:44.753963 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d200b30e-3a3e-4fd5-bec6-bff9f49e6229 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:44.754740 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d200b30e-3a3e-4fd5-bec6-bff9f49e6229 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:44.755146 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d200b30e-3a3e-4fd5-bec6-bff9f49e6229 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:44.789678 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-437b968e-ec56-4d0e-99e2-9e87ceac7738 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] HTTP exception thrown: Cannot 'detach_volume' instance 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd while it is in vm_state rescued Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-437b968e-ec56-4d0e-99e2-9e87ceac7738 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Request method failure captured: Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: DELETE /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd/os-volume_attachments/ce3d5c1a-fafd-4eb2-9bad-6b2b875c2f4c HTTP/1.1 Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1Z54hJE2l_KKrM9e-Q92EFzRQefo-JKdfbLMPwz8oT-C787IrLRWMX8P4Lf_5ySi9IC_PuB8AW1WtFXSETwf3dcsXRZWC9FFHHN_a0Os7DqGZog0zeiyFPM_4eOL5z3sIiGBxl1xGfVrAMC6ZsPAzRZXMxNahInJw9LdOx_iPcmPBQ Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: c3592ee016d1486db983b4ff2aab5ca3 Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1916877350 Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:19:44.791512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:19:44.792911 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c3592ee016d1486db983b4ff2aab5ca3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c3592ee016d1486db983b4ff2aab5ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c3592ee016d1486db983b4ff2aab5ca3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c3592ee016d1486db983b4ff2aab5ca3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:19:44.792911 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1916877350 Jun 16 16:19:44.792911 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: c3592ee016d1486db983b4ff2aab5ca3 Jun 16 16:19:44.792911 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1916877350 Jun 16 16:19:44.792911 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-ServerRescueNegativeTestJSON-1916877350-project Jun 16 16:19:44.792911 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:19:44.792911 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:19:44.792911 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: 16b8389777744e6581ad14be85731f4a Jun 16 16:19:44.792911 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1916877350-project Jun 16 16:19:44.792911 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:19:44.792911 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Cannot 'detach_volume' instance 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd while it is in vm_state rescued Jun 16 16:19:44.793748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'server_id': '3bac54eb-7ea8-4c97-a1f1-7c1da22baccd', 'id': 'ce3d5c1a-fafd-4eb2-9bad-6b2b875c2f4c'} Jun 16 16:19:44.793748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:19:44.793748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:44.793748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 16:19:44.793748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 16:19:44.793748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 16:19:44.793748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 16:19:44.793748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 16:19:44.793748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 16:19:44.793748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 16:19:44.793748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:19:44.793748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:19:44.793748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:19:44.793748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:44.793748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:19:44.793748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:19:44.793748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:19:44.793748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:19:44.793748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:19:44.793748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:19:44.795237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 16:19:44.795237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 16:19:44.795237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 16:19:44.795237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 16:19:44.795237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd while it is in vm_state rescued Jun 16 16:19:44.795237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:19:44.795237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:19:44.795237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:19:44.795237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:44.795237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:19:44.795237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:19:44.795237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:19:44.795237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:19:44.795237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd while it is in vm_state rescued Jun 16 16:19:44.795237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:19:44.795237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-437b968e-ec56-4d0e-99e2-9e87ceac7738 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Returning 409 to user: Cannot 'detach_volume' instance 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd while it is in vm_state rescued {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:19:44.796244 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-437b968e-ec56-4d0e-99e2-9e87ceac7738 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd/os-volume_attachments/ce3d5c1a-fafd-4eb2-9bad-6b2b875c2f4c" status: 409 len: 152 microversion: 2.1 time: 0.105619 Jun 16 16:19:44.796244 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 419/839] 10.222.0.88 () {58 vars in 1415 bytes} [Thu Jun 16 16:19:44 2022] DELETE /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd/os-volume_attachments/ce3d5c1a-fafd-4eb2-9bad-6b2b875c2f4c => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 16 16:19:44.801909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-09a58028-e3e6-499d-97e6-c601391c7103 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:44.802442 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-09a58028-e3e6-499d-97e6-c601391c7103 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:44.808526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-09a58028-e3e6-499d-97e6-c601391c7103 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:44.808973 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-09a58028-e3e6-499d-97e6-c601391c7103 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:44.809752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-09a58028-e3e6-499d-97e6-c601391c7103 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:44.810356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-09a58028-e3e6-499d-97e6-c601391c7103 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:44.882409 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-09a58028-e3e6-499d-97e6-c601391c7103 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "POST /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd/action" status: 202 len: 0 microversion: 2.1 time: 0.083821 Jun 16 16:19:44.883041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 420/840] 10.222.0.88 () {60 vars in 1277 bytes} [Thu Jun 16 16:19:44 2022] POST /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:19:44.891797 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-db857e43-8d28-40f2-a05a-19e6b45b9b54 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:44.892649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-db857e43-8d28-40f2-a05a-19e6b45b9b54 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:44.899216 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-db857e43-8d28-40f2-a05a-19e6b45b9b54 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:44.900053 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-db857e43-8d28-40f2-a05a-19e6b45b9b54 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:44.900904 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-db857e43-8d28-40f2-a05a-19e6b45b9b54 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:44.901620 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-db857e43-8d28-40f2-a05a-19e6b45b9b54 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:44.904437 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d200b30e-3a3e-4fd5-bec6-bff9f49e6229 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:44.912928 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d200b30e-3a3e-4fd5-bec6-bff9f49e6229 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1517 microversion: 2.1 time: 0.170176 Jun 16 16:19:44.920795 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 421/841] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:44 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:45.036735 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-db857e43-8d28-40f2-a05a-19e6b45b9b54 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:45.044872 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-db857e43-8d28-40f2-a05a-19e6b45b9b54 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1725 microversion: 2.1 time: 0.157481 Jun 16 16:19:45.045982 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 421/842] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:44 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:45.930297 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6b1cca23-0cc4-4fbf-91e8-4c8d2d2273f0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:45.930945 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6b1cca23-0cc4-4fbf-91e8-4c8d2d2273f0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:45.937541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6b1cca23-0cc4-4fbf-91e8-4c8d2d2273f0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:45.938024 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6b1cca23-0cc4-4fbf-91e8-4c8d2d2273f0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:45.938797 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6b1cca23-0cc4-4fbf-91e8-4c8d2d2273f0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:45.939236 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6b1cca23-0cc4-4fbf-91e8-4c8d2d2273f0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:45.943228 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=100 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:46.063691 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1d7d7024-f942-48af-bed9-3aa4c3cec5c2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:46.064337 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1d7d7024-f942-48af-bed9-3aa4c3cec5c2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:46.071427 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1d7d7024-f942-48af-bed9-3aa4c3cec5c2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:46.071994 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1d7d7024-f942-48af-bed9-3aa4c3cec5c2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:46.072678 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1d7d7024-f942-48af-bed9-3aa4c3cec5c2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:46.073118 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1d7d7024-f942-48af-bed9-3aa4c3cec5c2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:46.552673 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6b1cca23-0cc4-4fbf-91e8-4c8d2d2273f0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:46.560389 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6b1cca23-0cc4-4fbf-91e8-4c8d2d2273f0 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1573 microversion: 2.1 time: 0.633953 Jun 16 16:19:46.561786 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 422/843] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:45 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1573 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:46.565383 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1d7d7024-f942-48af-bed9-3aa4c3cec5c2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:46.573910 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1d7d7024-f942-48af-bed9-3aa4c3cec5c2 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1725 microversion: 2.1 time: 0.514714 Jun 16 16:19:46.574573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 422/844] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:46 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1725 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:47.577057 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f3d813dc-ddbe-4306-b4fe-d118516e2587 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:47.577744 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f3d813dc-ddbe-4306-b4fe-d118516e2587 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:47.584685 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3d813dc-ddbe-4306-b4fe-d118516e2587 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:47.585153 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3d813dc-ddbe-4306-b4fe-d118516e2587 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:47.585930 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3d813dc-ddbe-4306-b4fe-d118516e2587 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:47.586360 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3d813dc-ddbe-4306-b4fe-d118516e2587 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:47.591605 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ce982486-c3aa-47bb-91be-9a5cd3f22609 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:47.592716 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ce982486-c3aa-47bb-91be-9a5cd3f22609 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:47.599427 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ce982486-c3aa-47bb-91be-9a5cd3f22609 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:47.599887 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ce982486-c3aa-47bb-91be-9a5cd3f22609 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:47.600666 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ce982486-c3aa-47bb-91be-9a5cd3f22609 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:47.601109 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ce982486-c3aa-47bb-91be-9a5cd3f22609 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:47.790581 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f3d813dc-ddbe-4306-b4fe-d118516e2587 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:47.793826 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ce982486-c3aa-47bb-91be-9a5cd3f22609 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:47.798937 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f3d813dc-ddbe-4306-b4fe-d118516e2587 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1573 microversion: 2.1 time: 0.225785 Jun 16 16:19:47.799617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 423/845] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:47 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1573 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:47.802857 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ce982486-c3aa-47bb-91be-9a5cd3f22609 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1725 microversion: 2.1 time: 0.215028 Jun 16 16:19:47.803410 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 423/846] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:47 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:48.817047 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0c28cd31-2582-40a6-800b-a0c6fb4d08eb tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:48.817765 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0c28cd31-2582-40a6-800b-a0c6fb4d08eb tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:48.820390 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ec3ccad4-6892-4461-8bb1-21a027e2be57 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:48.821007 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ec3ccad4-6892-4461-8bb1-21a027e2be57 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:48.824565 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0c28cd31-2582-40a6-800b-a0c6fb4d08eb tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:48.825005 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0c28cd31-2582-40a6-800b-a0c6fb4d08eb tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:48.825778 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0c28cd31-2582-40a6-800b-a0c6fb4d08eb tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:48.826248 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0c28cd31-2582-40a6-800b-a0c6fb4d08eb tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:48.827596 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ec3ccad4-6892-4461-8bb1-21a027e2be57 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:48.828050 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ec3ccad4-6892-4461-8bb1-21a027e2be57 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:48.828818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ec3ccad4-6892-4461-8bb1-21a027e2be57 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:48.829258 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ec3ccad4-6892-4461-8bb1-21a027e2be57 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:49.022351 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0c28cd31-2582-40a6-800b-a0c6fb4d08eb tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:49.029112 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ec3ccad4-6892-4461-8bb1-21a027e2be57 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:49.030612 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0c28cd31-2582-40a6-800b-a0c6fb4d08eb tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1573 microversion: 2.1 time: 0.217817 Jun 16 16:19:49.031384 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 424/847] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:48 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1573 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:49.037131 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ec3ccad4-6892-4461-8bb1-21a027e2be57 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1725 microversion: 2.1 time: 0.220719 Jun 16 16:19:49.037687 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 424/848] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:48 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:50.048301 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7b511003-5294-46f1-aa90-e478f2e5adb3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:50.048968 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7b511003-5294-46f1-aa90-e478f2e5adb3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:50.052202 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=67 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:50.054788 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6add1018-7920-49de-a0a8-b441e5f7bf2c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:50.055417 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6add1018-7920-49de-a0a8-b441e5f7bf2c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:50.057823 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7b511003-5294-46f1-aa90-e478f2e5adb3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:50.058275 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7b511003-5294-46f1-aa90-e478f2e5adb3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:50.059044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7b511003-5294-46f1-aa90-e478f2e5adb3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:50.059477 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7b511003-5294-46f1-aa90-e478f2e5adb3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:50.061980 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6add1018-7920-49de-a0a8-b441e5f7bf2c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:50.062432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6add1018-7920-49de-a0a8-b441e5f7bf2c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:50.063178 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6add1018-7920-49de-a0a8-b441e5f7bf2c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:50.063608 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6add1018-7920-49de-a0a8-b441e5f7bf2c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:50.259371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7b511003-5294-46f1-aa90-e478f2e5adb3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:50.262834 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6add1018-7920-49de-a0a8-b441e5f7bf2c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:50.267053 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7b511003-5294-46f1-aa90-e478f2e5adb3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1573 microversion: 2.1 time: 0.222900 Jun 16 16:19:50.267786 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 425/849] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:50 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1573 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:50.270804 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6add1018-7920-49de-a0a8-b441e5f7bf2c tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1725 microversion: 2.1 time: 0.220523 Jun 16 16:19:50.271363 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 425/850] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:50 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:51.285522 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6f379f4e-2821-4bfa-93d9-f414baf3b80f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:51.286300 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6f379f4e-2821-4bfa-93d9-f414baf3b80f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:51.287563 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c9a1360b-d108-445d-8d81-a71035252c9f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:51.288171 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c9a1360b-d108-445d-8d81-a71035252c9f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:51.292879 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6f379f4e-2821-4bfa-93d9-f414baf3b80f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:51.293328 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6f379f4e-2821-4bfa-93d9-f414baf3b80f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:51.294144 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6f379f4e-2821-4bfa-93d9-f414baf3b80f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:51.294574 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6f379f4e-2821-4bfa-93d9-f414baf3b80f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:51.294695 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c9a1360b-d108-445d-8d81-a71035252c9f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:51.295660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c9a1360b-d108-445d-8d81-a71035252c9f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:51.296422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c9a1360b-d108-445d-8d81-a71035252c9f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:51.296854 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c9a1360b-d108-445d-8d81-a71035252c9f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:51.491047 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6f379f4e-2821-4bfa-93d9-f414baf3b80f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:51.499347 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c9a1360b-d108-445d-8d81-a71035252c9f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:51.499601 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6f379f4e-2821-4bfa-93d9-f414baf3b80f tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1573 microversion: 2.1 time: 0.218014 Jun 16 16:19:51.500590 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 426/851] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:51 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1573 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:51.507542 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c9a1360b-d108-445d-8d81-a71035252c9f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1731 microversion: 2.1 time: 0.223794 Jun 16 16:19:51.508095 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 426/852] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:51 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1731 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:51.524506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2709bc9a-00f2-4b36-aba7-073f1e54d79d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:51.524992 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2709bc9a-00f2-4b36-aba7-073f1e54d79d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:51.531762 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2709bc9a-00f2-4b36-aba7-073f1e54d79d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:51.532202 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2709bc9a-00f2-4b36-aba7-073f1e54d79d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:51.532949 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2709bc9a-00f2-4b36-aba7-073f1e54d79d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:51.533371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2709bc9a-00f2-4b36-aba7-073f1e54d79d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:51.613579 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2709bc9a-00f2-4b36-aba7-073f1e54d79d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092736 Jun 16 16:19:51.614200 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 427/853] 10.222.0.88 () {58 vars in 1274 bytes} [Thu Jun 16 16:19:51 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:19:52.461104 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-592d4db2-fe2b-4415-96d1-a7e1ef03c2be req-92b52287-a898-452c-b1cf-a52f763a71d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bac54eb-7ea8-4c97-a1f1-7c1da22baccd", "tag": "620a39ba-f7e2-4ae1-acf0-e87136dc559c"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:52.469996 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-592d4db2-fe2b-4415-96d1-a7e1ef03c2be req-92b52287-a898-452c-b1cf-a52f763a71d3 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:52.470440 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-592d4db2-fe2b-4415-96d1-a7e1ef03c2be req-92b52287-a898-452c-b1cf-a52f763a71d3 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:52.482981 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-592d4db2-fe2b-4415-96d1-a7e1ef03c2be req-92b52287-a898-452c-b1cf-a52f763a71d3 service nova] Creating event network-changed:620a39ba-f7e2-4ae1-acf0-e87136dc559c for instance 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd on hv-cinder-83735 Jun 16 16:19:52.488685 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-592d4db2-fe2b-4415-96d1-a7e1ef03c2be req-92b52287-a898-452c-b1cf-a52f763a71d3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031169 Jun 16 16:19:52.489446 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 427/854] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:19:52.517375 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3ac54582-3a83-44f2-8348-245baaf9dfbf tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:52.518006 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3ac54582-3a83-44f2-8348-245baaf9dfbf tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:52.523879 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3ac54582-3a83-44f2-8348-245baaf9dfbf tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:52.524317 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3ac54582-3a83-44f2-8348-245baaf9dfbf tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:52.525160 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3ac54582-3a83-44f2-8348-245baaf9dfbf tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:52.525590 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3ac54582-3a83-44f2-8348-245baaf9dfbf tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:52.757173 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3ac54582-3a83-44f2-8348-245baaf9dfbf tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:52.766028 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3ac54582-3a83-44f2-8348-245baaf9dfbf tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1573 microversion: 2.1 time: 0.253006 Jun 16 16:19:52.766609 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 428/855] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:52 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1573 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:53.784037 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-cf08867b-2e37-4643-919a-38dbbe977316 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:53.784852 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-cf08867b-2e37-4643-919a-38dbbe977316 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:53.791186 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cf08867b-2e37-4643-919a-38dbbe977316 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:53.791625 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cf08867b-2e37-4643-919a-38dbbe977316 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:53.792381 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cf08867b-2e37-4643-919a-38dbbe977316 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:53.792811 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-cf08867b-2e37-4643-919a-38dbbe977316 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:53.926275 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-cf08867b-2e37-4643-919a-38dbbe977316 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:53.933691 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-cf08867b-2e37-4643-919a-38dbbe977316 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1573 microversion: 2.1 time: 0.154536 Jun 16 16:19:53.934270 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 428/856] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:53 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:54.505395 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-484c5962-d0d2-484d-9eef-d8862179087b req-65c4c7ea-b8c3-47d2-a741-6279e83a3e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bac54eb-7ea8-4c97-a1f1-7c1da22baccd", "tag": "620a39ba-f7e2-4ae1-acf0-e87136dc559c"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:54.513858 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-484c5962-d0d2-484d-9eef-d8862179087b req-65c4c7ea-b8c3-47d2-a741-6279e83a3e0b service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:54.514296 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-484c5962-d0d2-484d-9eef-d8862179087b req-65c4c7ea-b8c3-47d2-a741-6279e83a3e0b service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:54.525053 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-484c5962-d0d2-484d-9eef-d8862179087b req-65c4c7ea-b8c3-47d2-a741-6279e83a3e0b service nova] Creating event network-changed:620a39ba-f7e2-4ae1-acf0-e87136dc559c for instance 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd on hv-cinder-83735 Jun 16 16:19:54.530735 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-484c5962-d0d2-484d-9eef-d8862179087b req-65c4c7ea-b8c3-47d2-a741-6279e83a3e0b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028913 Jun 16 16:19:54.531313 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 429/857] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:19:54.951073 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0448c0cf-bc1e-46d2-83d6-d42b2420a982 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:54.951687 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0448c0cf-bc1e-46d2-83d6-d42b2420a982 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:54.958389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0448c0cf-bc1e-46d2-83d6-d42b2420a982 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:54.958840 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0448c0cf-bc1e-46d2-83d6-d42b2420a982 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:54.959604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0448c0cf-bc1e-46d2-83d6-d42b2420a982 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:54.960036 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0448c0cf-bc1e-46d2-83d6-d42b2420a982 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:55.067289 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-01cdfbbf-1abb-4bdd-aaec-c445ef5adaf2 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:55.067870 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-01cdfbbf-1abb-4bdd-aaec-c445ef5adaf2 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:55.074221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01cdfbbf-1abb-4bdd-aaec-c445ef5adaf2 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:55.074678 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01cdfbbf-1abb-4bdd-aaec-c445ef5adaf2 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:55.075448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01cdfbbf-1abb-4bdd-aaec-c445ef5adaf2 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:55.075885 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01cdfbbf-1abb-4bdd-aaec-c445ef5adaf2 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:55.099631 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-01cdfbbf-1abb-4bdd-aaec-c445ef5adaf2 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f/ips" status: 200 len: 150 microversion: 2.1 time: 0.036482 Jun 16 16:19:55.100227 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 430/858] 10.222.0.88 () {58 vars in 1247 bytes} [Thu Jun 16 16:19:55 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:19:55.109192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0448c0cf-bc1e-46d2-83d6-d42b2420a982 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:55.111894 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6bcf44bf-506c-427e-927f-a4bbbab812de tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f6d88ca-c4b2-4ac7-a03f-179aee37c78d"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:55.112995 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6bcf44bf-506c-427e-927f-a4bbbab812de tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:55.117043 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0448c0cf-bc1e-46d2-83d6-d42b2420a982 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1573 microversion: 2.1 time: 0.169925 Jun 16 16:19:55.118181 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 429/859] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:54 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:55.128090 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6bcf44bf-506c-427e-927f-a4bbbab812de tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:55.128603 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6bcf44bf-506c-427e-927f-a4bbbab812de tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:55.129382 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6bcf44bf-506c-427e-927f-a4bbbab812de tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:55.129848 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6bcf44bf-506c-427e-927f-a4bbbab812de tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:55.213019 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-6bcf44bf-506c-427e-927f-a4bbbab812de tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] HTTP exception thrown: Invalid volume: volume 4f6d88ca-c4b2-4ac7-a03f-179aee37c78d is already attached to instances: 6776a1f2-1043-4048-99e7-cdc91959fe40 Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6bcf44bf-506c-427e-927f-a4bbbab812de tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Request method failure captured: Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: POST /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f/os-volume_attachments HTTP/1.1 Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 74 Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1Z8eNcA8LvE_QGupE8IwZgqoLdb4bdar2JFxF-sM8vVrpRiD1EIWMp99ewnT5la5EmpgmBAQZOsVfs3XmSmDWWlPn9Df8pyp8HGhxHfE9ShSTZ5F3NEdcePS6LELsIFGFBpMHeDDC0nVbCEOCxMglGuS8woh2jjuJT6Oy7NXlIFCC8 Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:19:55.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:19:55.216387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c1cdf363c2e44af5b0d8cd748c58235b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:19:55.216387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:19:55.216387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:19:55.216387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:19:55.216387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:19:55.216387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:19:55.216387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:19:55.216387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: bfbcc9b45bc341228bcc0f2192040224 Jun 16 16:19:55.216387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:19:55.216387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Jun 16 16:19:55.216387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {"volumeAttachment": {"volumeId": "4f6d88ca-c4b2-4ac7-a03f-179aee37c78d"}} Jun 16 16:19:55.216387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:19:55.217835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Invalid volume: volume 4f6d88ca-c4b2-4ac7-a03f-179aee37c78d is already attached to instances: 6776a1f2-1043-4048-99e7-cdc91959fe40 Jun 16 16:19:55.217835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'server_id': '1331116f-adf2-4957-9d58-6436d217e73f', 'body': {'volumeAttachment': {'volumeId': '4f6d88ca-c4b2-4ac7-a03f-179aee37c78d'}}} Jun 16 16:19:55.217835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:19:55.217835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:55.217835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 16:19:55.217835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 16:19:55.217835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 16:19:55.217835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 16:19:55.217835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 16:19:55.217835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 16:19:55.217835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 16:19:55.217835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 16:19:55.217835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 16:19:55.217835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 16:19:55.217835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4f6d88ca-c4b2-4ac7-a03f-179aee37c78d is already attached to instances: 6776a1f2-1043-4048-99e7-cdc91959fe40 Jun 16 16:19:55.217835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:19:55.217835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:19:55.217835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:19:55.217835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:55.219608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:19:55.219608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:19:55.219608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:19:55.219608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:19:55.219608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:19:55.219608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:19:55.219608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:19:55.219608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:19:55.219608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:19:55.219608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:19:55.219608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:19:55.219608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:19:55.219608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 16:19:55.219608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 16:19:55.219608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4f6d88ca-c4b2-4ac7-a03f-179aee37c78d is already attached to instances: 6776a1f2-1043-4048-99e7-cdc91959fe40 Jun 16 16:19:55.219608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:19:55.219608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:19:55.219608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:19:55.219608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:19:55.219608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:19:55.221080 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:19:55.221080 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:19:55.221080 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:19:55.221080 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4f6d88ca-c4b2-4ac7-a03f-179aee37c78d is already attached to instances: 6776a1f2-1043-4048-99e7-cdc91959fe40 Jun 16 16:19:55.221080 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:19:55.221080 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6bcf44bf-506c-427e-927f-a4bbbab812de tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Returning 400 to user: Invalid volume: volume 4f6d88ca-c4b2-4ac7-a03f-179aee37c78d is already attached to instances: 6776a1f2-1043-4048-99e7-cdc91959fe40 {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:19:55.221080 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6bcf44bf-506c-427e-927f-a4bbbab812de tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "POST /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109010 Jun 16 16:19:55.221080 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 431/860] 10.222.0.88 () {60 vars in 1322 bytes} [Thu Jun 16 16:19:55 2022] POST /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:19:55.225876 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e5dc3712-08da-4380-bbf4-18849e633591 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:55.226379 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e5dc3712-08da-4380-bbf4-18849e633591 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:55.232610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e5dc3712-08da-4380-bbf4-18849e633591 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:55.233060 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e5dc3712-08da-4380-bbf4-18849e633591 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:55.233885 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e5dc3712-08da-4380-bbf4-18849e633591 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:55.234332 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e5dc3712-08da-4380-bbf4-18849e633591 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:55.258902 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e5dc3712-08da-4380-bbf4-18849e633591 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:19:55.333284 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e5dc3712-08da-4380-bbf4-18849e633591 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 204 len: 0 microversion: 2.1 time: 0.111179 Jun 16 16:19:55.333813 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 430/861] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:19:55 2022] DELETE /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:19:55.343504 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ad190ba0-af0a-4833-a678-9c0f1325cf67 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:55.344131 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ad190ba0-af0a-4833-a678-9c0f1325cf67 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:55.351327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ad190ba0-af0a-4833-a678-9c0f1325cf67 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:55.351897 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ad190ba0-af0a-4833-a678-9c0f1325cf67 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:55.352688 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ad190ba0-af0a-4833-a678-9c0f1325cf67 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:55.353124 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ad190ba0-af0a-4833-a678-9c0f1325cf67 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:55.488047 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ad190ba0-af0a-4833-a678-9c0f1325cf67 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:55.495448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ad190ba0-af0a-4833-a678-9c0f1325cf67 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1681 microversion: 2.1 time: 0.156239 Jun 16 16:19:55.496014 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 432/862] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:55 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:56.135109 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d0e4e20d-5bb4-430b-84ec-61596f587f40 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:56.135810 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d0e4e20d-5bb4-430b-84ec-61596f587f40 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:56.143127 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d0e4e20d-5bb4-430b-84ec-61596f587f40 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:56.143580 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d0e4e20d-5bb4-430b-84ec-61596f587f40 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:56.144349 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d0e4e20d-5bb4-430b-84ec-61596f587f40 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:56.144790 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d0e4e20d-5bb4-430b-84ec-61596f587f40 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:56.285781 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d0e4e20d-5bb4-430b-84ec-61596f587f40 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:56.293453 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d0e4e20d-5bb4-430b-84ec-61596f587f40 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1573 microversion: 2.1 time: 0.162832 Jun 16 16:19:56.294058 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 431/863] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:56 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:56.511974 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-23506c10-93c5-46d8-bf8b-b7f7c6db4862 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:56.512583 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-23506c10-93c5-46d8-bf8b-b7f7c6db4862 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:56.519148 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-23506c10-93c5-46d8-bf8b-b7f7c6db4862 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:56.519593 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-23506c10-93c5-46d8-bf8b-b7f7c6db4862 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:56.520364 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-23506c10-93c5-46d8-bf8b-b7f7c6db4862 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:56.520799 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-23506c10-93c5-46d8-bf8b-b7f7c6db4862 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:56.655060 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-23506c10-93c5-46d8-bf8b-b7f7c6db4862 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:56.664652 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-23506c10-93c5-46d8-bf8b-b7f7c6db4862 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1681 microversion: 2.1 time: 0.156408 Jun 16 16:19:56.665456 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 433/864] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:56 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:19:57.311360 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a6c6bf18-2686-46d9-bfb0-a84deaa760ad tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:57.311969 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a6c6bf18-2686-46d9-bfb0-a84deaa760ad tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:57.318479 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a6c6bf18-2686-46d9-bfb0-a84deaa760ad tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:57.318923 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a6c6bf18-2686-46d9-bfb0-a84deaa760ad tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:57.319676 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a6c6bf18-2686-46d9-bfb0-a84deaa760ad tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:57.320110 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a6c6bf18-2686-46d9-bfb0-a84deaa760ad tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:57.454306 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a6c6bf18-2686-46d9-bfb0-a84deaa760ad tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:57.461909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a6c6bf18-2686-46d9-bfb0-a84deaa760ad tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1573 microversion: 2.1 time: 0.154845 Jun 16 16:19:57.462634 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 432/865] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:57 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:57.684393 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5f940e55-8917-4e35-8424-97f21c1b0aea tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:57.684926 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5f940e55-8917-4e35-8424-97f21c1b0aea tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:57.691531 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5f940e55-8917-4e35-8424-97f21c1b0aea tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:57.691984 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5f940e55-8917-4e35-8424-97f21c1b0aea tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:57.692745 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5f940e55-8917-4e35-8424-97f21c1b0aea tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:57.693181 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5f940e55-8917-4e35-8424-97f21c1b0aea tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:57.821468 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5f940e55-8917-4e35-8424-97f21c1b0aea tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:57.828888 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5f940e55-8917-4e35-8424-97f21c1b0aea tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1681 microversion: 2.1 time: 0.148518 Jun 16 16:19:57.829455 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 434/866] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:57 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:58.479943 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5554d645-a673-4e04-bca1-33feea1fb292 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:58.480511 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5554d645-a673-4e04-bca1-33feea1fb292 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:58.486639 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5554d645-a673-4e04-bca1-33feea1fb292 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:58.487086 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5554d645-a673-4e04-bca1-33feea1fb292 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:58.487846 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5554d645-a673-4e04-bca1-33feea1fb292 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:58.488276 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5554d645-a673-4e04-bca1-33feea1fb292 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:58.623337 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5554d645-a673-4e04-bca1-33feea1fb292 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:58.630998 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5554d645-a673-4e04-bca1-33feea1fb292 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1573 microversion: 2.1 time: 0.155223 Jun 16 16:19:58.631565 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 433/867] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:58 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:58.847365 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-59f6bcdf-bdab-4bbc-b910-6593c54beb7a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:58.848690 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-59f6bcdf-bdab-4bbc-b910-6593c54beb7a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:58.856532 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-59f6bcdf-bdab-4bbc-b910-6593c54beb7a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:58.856989 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-59f6bcdf-bdab-4bbc-b910-6593c54beb7a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:58.858619 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-59f6bcdf-bdab-4bbc-b910-6593c54beb7a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:58.859143 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-59f6bcdf-bdab-4bbc-b910-6593c54beb7a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:59.317662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-59f6bcdf-bdab-4bbc-b910-6593c54beb7a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:59.325673 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-59f6bcdf-bdab-4bbc-b910-6593c54beb7a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1681 microversion: 2.1 time: 0.482422 Jun 16 16:19:59.326500 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 435/868] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:58 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1681 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:59.648699 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2ab77425-8a8e-4242-9c15-e8c25ce10c9c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:19:59.649700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2ab77425-8a8e-4242-9c15-e8c25ce10c9c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:19:59.658239 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2ab77425-8a8e-4242-9c15-e8c25ce10c9c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:59.658697 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2ab77425-8a8e-4242-9c15-e8c25ce10c9c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:59.659538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2ab77425-8a8e-4242-9c15-e8c25ce10c9c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:59.660068 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2ab77425-8a8e-4242-9c15-e8c25ce10c9c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:59.664413 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:59.881999 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2ab77425-8a8e-4242-9c15-e8c25ce10c9c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:19:59.889782 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2ab77425-8a8e-4242-9c15-e8c25ce10c9c tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1573 microversion: 2.1 time: 0.245115 Jun 16 16:19:59.891005 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 434/869] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:19:59 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1573 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:19:59.950586 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-8d757f2c-35f0-4112-84ae-73bb05d8db77 req-32dc0b0d-96cd-4fa3-a6e4-6f50a4c2d316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1331116f-adf2-4957-9d58-6436d217e73f", "name": "network-vif-deleted", "tag": "715cac73-0f61-46bf-aeb4-a3dbfabc5eab"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:19:59.959821 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-8d757f2c-35f0-4112-84ae-73bb05d8db77 req-32dc0b0d-96cd-4fa3-a6e4-6f50a4c2d316 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:19:59.960349 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-8d757f2c-35f0-4112-84ae-73bb05d8db77 req-32dc0b0d-96cd-4fa3-a6e4-6f50a4c2d316 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:19:59.974071 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-8d757f2c-35f0-4112-84ae-73bb05d8db77 req-32dc0b0d-96cd-4fa3-a6e4-6f50a4c2d316 service nova] Creating event network-vif-deleted:715cac73-0f61-46bf-aeb4-a3dbfabc5eab for instance 1331116f-adf2-4957-9d58-6436d217e73f on hv-cinder-83735 Jun 16 16:19:59.980731 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-8d757f2c-35f0-4112-84ae-73bb05d8db77 req-32dc0b0d-96cd-4fa3-a6e4-6f50a4c2d316 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034141 Jun 16 16:19:59.981873 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 436/870] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:00.343754 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f037b4aa-603d-479a-af51-aa7498112cef tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:00.344365 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f037b4aa-603d-479a-af51-aa7498112cef tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:00.350676 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f037b4aa-603d-479a-af51-aa7498112cef tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:00.351123 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f037b4aa-603d-479a-af51-aa7498112cef tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:00.351887 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f037b4aa-603d-479a-af51-aa7498112cef tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:00.352548 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f037b4aa-603d-479a-af51-aa7498112cef tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:00.386045 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f037b4aa-603d-479a-af51-aa7498112cef tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:00.386435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f037b4aa-603d-479a-af51-aa7498112cef tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:00.386910 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-f037b4aa-603d-479a-af51-aa7498112cef tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lazy-loading 'fault' on Instance uuid 1331116f-adf2-4957-9d58-6436d217e73f {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:20:00.437316 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f037b4aa-603d-479a-af51-aa7498112cef tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:00.445445 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f037b4aa-603d-479a-af51-aa7498112cef tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 200 len: 1330 microversion: 2.1 time: 0.106105 Jun 16 16:20:00.446201 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 435/871] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:00 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 1330 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:20:00.878325 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-77c102ee-7475-4b7b-8890-cedf56fdd8a6 req-03f0542d-a5d1-4495-9906-bdf2f3456882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c92e5c48-0ac8-4a24-9e6b-019b7825b0b4", "name": "network-vif-plugged", "status": "completed", "tag": "fd0e55d6-c023-4540-8b9f-28e600c52b4f"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:20:00.890997 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-77c102ee-7475-4b7b-8890-cedf56fdd8a6 req-03f0542d-a5d1-4495-9906-bdf2f3456882 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:00.891822 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-77c102ee-7475-4b7b-8890-cedf56fdd8a6 req-03f0542d-a5d1-4495-9906-bdf2f3456882 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:00.905218 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-77c102ee-7475-4b7b-8890-cedf56fdd8a6 req-03f0542d-a5d1-4495-9906-bdf2f3456882 service nova] Creating event network-vif-plugged:fd0e55d6-c023-4540-8b9f-28e600c52b4f for instance c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 on hv-cinder-83735 Jun 16 16:20:00.908552 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c76e1b2a-7fdf-49b4-983c-8b8b018e113d tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:00.908946 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c76e1b2a-7fdf-49b4-983c-8b8b018e113d tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:00.917792 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-77c102ee-7475-4b7b-8890-cedf56fdd8a6 req-03f0542d-a5d1-4495-9906-bdf2f3456882 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046007 Jun 16 16:20:00.918191 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c76e1b2a-7fdf-49b4-983c-8b8b018e113d tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:00.918827 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c76e1b2a-7fdf-49b4-983c-8b8b018e113d tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:00.920143 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c76e1b2a-7fdf-49b4-983c-8b8b018e113d tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:00.920295 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 437/872] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:00.920901 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c76e1b2a-7fdf-49b4-983c-8b8b018e113d tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:01.095521 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c76e1b2a-7fdf-49b4-983c-8b8b018e113d tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:01.106123 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c76e1b2a-7fdf-49b4-983c-8b8b018e113d tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1573 microversion: 2.1 time: 0.201688 Jun 16 16:20:01.106813 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 436/873] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:00 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1573 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:01.465060 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5c78c49c-e3f1-49b3-98cc-dd91a2520880 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:01.465651 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5c78c49c-e3f1-49b3-98cc-dd91a2520880 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:01.472490 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5c78c49c-e3f1-49b3-98cc-dd91a2520880 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:01.473238 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5c78c49c-e3f1-49b3-98cc-dd91a2520880 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:01.474078 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5c78c49c-e3f1-49b3-98cc-dd91a2520880 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:01.474497 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5c78c49c-e3f1-49b3-98cc-dd91a2520880 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:01.490862 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-5c78c49c-e3f1-49b3-98cc-dd91a2520880 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] HTTP exception thrown: Instance 1331116f-adf2-4957-9d58-6436d217e73f could not be found. Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5c78c49c-e3f1-49b3-98cc-dd91a2520880 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Request method failure captured: Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f HTTP/1.1 Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1Z8eNcA8LvE_QGupE8IwZgqoLdb4bdar2JFxF-sM8vVrpRiD1EIWMp99ewnT5la5EmpgmBAQZOsVfs3XmSmDWWlPn9Df8pyp8HGhxHfE9ShSTZ5F3NEdcePS6LELsIFGFBpMHeDDC0nVbCEOCxMglGuS8woh2jjuJT6Oy7NXlIFCC8 Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:20:01.493646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:20:01.495316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c1cdf363c2e44af5b0d8cd748c58235b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:20:01.495316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:20:01.495316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:20:01.495316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:20:01.495316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:20:01.495316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:20:01.495316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:20:01.495316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: bfbcc9b45bc341228bcc0f2192040224 Jun 16 16:20:01.495316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:20:01.495316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:20:01.495316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance 1331116f-adf2-4957-9d58-6436d217e73f could not be found. Jun 16 16:20:01.495316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '1331116f-adf2-4957-9d58-6436d217e73f'} Jun 16 16:20:01.496221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:20:01.496221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:01.496221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:20:01.496221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:20:01.496221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:20:01.496221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:20:01.496221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:20:01.496221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:20:01.496221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:20:01.496221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:20:01.496221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1331116f-adf2-4957-9d58-6436d217e73f could not be found. Jun 16 16:20:01.496221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.496221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:01.496221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.496221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:01.496221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:01.496221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:01.496221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:20:01.496221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:20:01.496221 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:20:01.497791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:20:01.497791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:20:01.497791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:20:01.497791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:20:01.497791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:20:01.497791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:20:01.497791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:20:01.497791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1331116f-adf2-4957-9d58-6436d217e73f could not be found. Jun 16 16:20:01.497791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.497791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:01.497791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.497791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:01.497791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:01.497791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:01.497791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:20:01.497791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:20:01.497791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1331116f-adf2-4957-9d58-6436d217e73f could not be found. Jun 16 16:20:01.497791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:20:01.499131 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5c78c49c-e3f1-49b3-98cc-dd91a2520880 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Returning 404 to user: Instance 1331116f-adf2-4957-9d58-6436d217e73f could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:20:01.499131 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5c78c49c-e3f1-49b3-98cc-dd91a2520880 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 404 len: 111 microversion: 2.1 time: 0.035499 Jun 16 16:20:01.499131 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 438/874] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:01 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:20:01.506900 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f3e8146c-3899-44e2-beb6-8ba48cd365a2 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '.version_select at 0x7f6f0d159790>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:01.526340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f3e8146c-3899-44e2-beb6-8ba48cd365a2 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-416222513" status: 202 len: 0 microversion: 2.1 time: 0.023161 Jun 16 16:20:01.526926 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 437/875] 10.222.0.88 () {58 vars in 1217 bytes} [Thu Jun 16 16:20:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-416222513 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:20:02.125197 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0e7c1d4e-bf99-4875-8cc8-25a42993c4a3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:02.126298 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0e7c1d4e-bf99-4875-8cc8-25a42993c4a3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:02.134754 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0e7c1d4e-bf99-4875-8cc8-25a42993c4a3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:02.135469 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0e7c1d4e-bf99-4875-8cc8-25a42993c4a3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:02.140915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0e7c1d4e-bf99-4875-8cc8-25a42993c4a3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:02.141348 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0e7c1d4e-bf99-4875-8cc8-25a42993c4a3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:02.218016 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8fe3c5f5-1f58-4980-ba40-973bc39e049e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:02.218700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8fe3c5f5-1f58-4980-ba40-973bc39e049e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:02.225692 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8fe3c5f5-1f58-4980-ba40-973bc39e049e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:02.226095 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8fe3c5f5-1f58-4980-ba40-973bc39e049e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:02.226888 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8fe3c5f5-1f58-4980-ba40-973bc39e049e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:02.227325 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8fe3c5f5-1f58-4980-ba40-973bc39e049e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:02.281052 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0e7c1d4e-bf99-4875-8cc8-25a42993c4a3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:02.288584 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0e7c1d4e-bf99-4875-8cc8-25a42993c4a3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1573 microversion: 2.1 time: 0.168679 Jun 16 16:20:02.289233 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 439/876] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:02 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:02.309264 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-8fe3c5f5-1f58-4980-ba40-973bc39e049e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lazy-loading 'services' on Instance uuid 6776a1f2-1043-4048-99e7-cdc91959fe40 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:20:02.387414 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8fe3c5f5-1f58-4980-ba40-973bc39e049e tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40/os-volume_attachments/4f6d88ca-c4b2-4ac7-a03f-179aee37c78d" status: 202 len: 0 microversion: 2.1 time: 0.173212 Jun 16 16:20:02.387936 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 438/877] 10.222.0.88 () {58 vars in 1415 bytes} [Thu Jun 16 16:20:02 2022] DELETE /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40/os-volume_attachments/4f6d88ca-c4b2-4ac7-a03f-179aee37c78d => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:20:02.396193 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3ee2e758-ed45-4f58-a8da-fbdf49278981 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:02.397177 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3ee2e758-ed45-4f58-a8da-fbdf49278981 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:02.403459 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3ee2e758-ed45-4f58-a8da-fbdf49278981 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:02.403913 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3ee2e758-ed45-4f58-a8da-fbdf49278981 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:02.404678 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3ee2e758-ed45-4f58-a8da-fbdf49278981 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:02.405126 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3ee2e758-ed45-4f58-a8da-fbdf49278981 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:02.434337 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3ee2e758-ed45-4f58-a8da-fbdf49278981 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041960 Jun 16 16:20:02.434917 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 440/878] 10.222.0.88 () {58 vars in 1301 bytes} [Thu Jun 16 16:20:02 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:03.306947 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d3f45c90-dda0-469e-a10a-f271d65cea39 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:03.307733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d3f45c90-dda0-469e-a10a-f271d65cea39 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:03.315040 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d3f45c90-dda0-469e-a10a-f271d65cea39 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:03.315671 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d3f45c90-dda0-469e-a10a-f271d65cea39 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:03.316458 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d3f45c90-dda0-469e-a10a-f271d65cea39 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:03.317047 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d3f45c90-dda0-469e-a10a-f271d65cea39 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:03.446735 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8f0b36ef-197e-4857-a485-b82019b49c5c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:03.447674 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8f0b36ef-197e-4857-a485-b82019b49c5c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:03.449137 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d3f45c90-dda0-469e-a10a-f271d65cea39 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:03.454478 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8f0b36ef-197e-4857-a485-b82019b49c5c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:03.454930 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8f0b36ef-197e-4857-a485-b82019b49c5c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:03.455692 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8f0b36ef-197e-4857-a485-b82019b49c5c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:03.456124 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8f0b36ef-197e-4857-a485-b82019b49c5c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:03.458023 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d3f45c90-dda0-469e-a10a-f271d65cea39 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1560 microversion: 2.1 time: 0.155648 Jun 16 16:20:03.458816 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 439/879] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:03 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:03.486469 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8f0b36ef-197e-4857-a485-b82019b49c5c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043757 Jun 16 16:20:03.487052 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 441/880] 10.222.0.88 () {58 vars in 1301 bytes} [Thu Jun 16 16:20:03 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:20:04.499679 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2d645813-5d63-4745-b46c-45c49a1b7c53 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:04.500683 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2d645813-5d63-4745-b46c-45c49a1b7c53 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:04.507652 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2d645813-5d63-4745-b46c-45c49a1b7c53 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:04.508155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2d645813-5d63-4745-b46c-45c49a1b7c53 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:04.508938 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2d645813-5d63-4745-b46c-45c49a1b7c53 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:04.509375 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2d645813-5d63-4745-b46c-45c49a1b7c53 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:04.540365 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2d645813-5d63-4745-b46c-45c49a1b7c53 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046196 Jun 16 16:20:04.540919 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 440/881] 10.222.0.88 () {58 vars in 1301 bytes} [Thu Jun 16 16:20:04 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:20:04.599164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8334c741-6f2f-4e74-99a3-ea74c7c72825 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:04.599780 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8334c741-6f2f-4e74-99a3-ea74c7c72825 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:04.606331 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8334c741-6f2f-4e74-99a3-ea74c7c72825 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:04.607240 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8334c741-6f2f-4e74-99a3-ea74c7c72825 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:04.608014 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8334c741-6f2f-4e74-99a3-ea74c7c72825 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:04.608441 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8334c741-6f2f-4e74-99a3-ea74c7c72825 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:04.612431 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=100 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:04.634644 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8334c741-6f2f-4e74-99a3-ea74c7c72825 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:20:04.711438 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8334c741-6f2f-4e74-99a3-ea74c7c72825 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 204 len: 0 microversion: 2.1 time: 0.116220 Jun 16 16:20:04.712153 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 442/882] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:20:04 2022] DELETE /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:20:04.721055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-95884c3e-c80f-45af-b353-debac1b11244 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:04.721671 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-95884c3e-c80f-45af-b353-debac1b11244 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:04.728133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95884c3e-c80f-45af-b353-debac1b11244 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:04.728572 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95884c3e-c80f-45af-b353-debac1b11244 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:04.729336 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95884c3e-c80f-45af-b353-debac1b11244 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:04.729790 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-95884c3e-c80f-45af-b353-debac1b11244 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:04.862620 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-95884c3e-c80f-45af-b353-debac1b11244 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:04.869985 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-95884c3e-c80f-45af-b353-debac1b11244 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1681 microversion: 2.1 time: 0.152821 Jun 16 16:20:04.870553 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 441/883] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:04 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:05.887701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-32841a44-5ac0-4236-b26c-c5c116ff1133 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:05.888906 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-32841a44-5ac0-4236-b26c-c5c116ff1133 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:05.895488 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-32841a44-5ac0-4236-b26c-c5c116ff1133 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:05.895936 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-32841a44-5ac0-4236-b26c-c5c116ff1133 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:05.896695 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-32841a44-5ac0-4236-b26c-c5c116ff1133 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:05.897132 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-32841a44-5ac0-4236-b26c-c5c116ff1133 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:06.027894 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-32841a44-5ac0-4236-b26c-c5c116ff1133 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:06.036021 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-32841a44-5ac0-4236-b26c-c5c116ff1133 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1681 microversion: 2.1 time: 0.152596 Jun 16 16:20:06.036585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 443/884] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:05 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:06.886797 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-4df56139-50a7-454b-b9db-09696d1385bc req-bf61ee6a-148b-4f9e-a600-86eac4d36a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6776a1f2-1043-4048-99e7-cdc91959fe40", "name": "network-vif-deleted", "tag": "7a7bf458-a30a-41d7-a812-b5387bf22d99"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:20:06.897245 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-4df56139-50a7-454b-b9db-09696d1385bc req-bf61ee6a-148b-4f9e-a600-86eac4d36a8d service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:06.897688 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-4df56139-50a7-454b-b9db-09696d1385bc req-bf61ee6a-148b-4f9e-a600-86eac4d36a8d service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:06.910003 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-4df56139-50a7-454b-b9db-09696d1385bc req-bf61ee6a-148b-4f9e-a600-86eac4d36a8d service nova] Creating event network-vif-deleted:7a7bf458-a30a-41d7-a812-b5387bf22d99 for instance 6776a1f2-1043-4048-99e7-cdc91959fe40 on hv-cinder-83735 Jun 16 16:20:06.915070 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-4df56139-50a7-454b-b9db-09696d1385bc req-bf61ee6a-148b-4f9e-a600-86eac4d36a8d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031912 Jun 16 16:20:06.915676 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 442/885] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:07.052848 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-dc11bb40-4d7a-45f1-99b1-62eae9e8e0fa tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:07.054111 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-dc11bb40-4d7a-45f1-99b1-62eae9e8e0fa tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:07.066891 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dc11bb40-4d7a-45f1-99b1-62eae9e8e0fa tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:07.067339 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dc11bb40-4d7a-45f1-99b1-62eae9e8e0fa tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:07.068114 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dc11bb40-4d7a-45f1-99b1-62eae9e8e0fa tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:07.068549 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dc11bb40-4d7a-45f1-99b1-62eae9e8e0fa tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:07.112554 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dc11bb40-4d7a-45f1-99b1-62eae9e8e0fa tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:07.113319 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dc11bb40-4d7a-45f1-99b1-62eae9e8e0fa tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:07.113959 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-dc11bb40-4d7a-45f1-99b1-62eae9e8e0fa tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lazy-loading 'fault' on Instance uuid 6776a1f2-1043-4048-99e7-cdc91959fe40 {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:20:07.158414 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-dc11bb40-4d7a-45f1-99b1-62eae9e8e0fa tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:07.166050 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-dc11bb40-4d7a-45f1-99b1-62eae9e8e0fa tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 200 len: 1332 microversion: 2.1 time: 0.117101 Jun 16 16:20:07.166635 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 444/886] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:07 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:08.184900 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d243ab95-100b-4152-a477-0af2430194d8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:08.185612 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d243ab95-100b-4152-a477-0af2430194d8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:08.191887 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d243ab95-100b-4152-a477-0af2430194d8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:08.192350 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d243ab95-100b-4152-a477-0af2430194d8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:08.193143 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d243ab95-100b-4152-a477-0af2430194d8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:08.193581 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d243ab95-100b-4152-a477-0af2430194d8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:08.207433 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-d243ab95-100b-4152-a477-0af2430194d8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] HTTP exception thrown: Instance 6776a1f2-1043-4048-99e7-cdc91959fe40 could not be found. Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d243ab95-100b-4152-a477-0af2430194d8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Request method failure captured: Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 HTTP/1.1 Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1Z8eNcA8LvE_QGupE8IwZgqoLdb4bdar2JFxF-sM8vVrpRiD1EIWMp99ewnT5la5EmpgmBAQZOsVfs3XmSmDWWlPn9Df8pyp8HGhxHfE9ShSTZ5F3NEdcePS6LELsIFGFBpMHeDDC0nVbCEOCxMglGuS8woh2jjuJT6Oy7NXlIFCC8 Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:20:08.209083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:20:08.210677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c1cdf363c2e44af5b0d8cd748c58235b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:20:08.210677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:20:08.210677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:20:08.210677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:20:08.210677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:20:08.210677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:20:08.210677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:20:08.210677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: bfbcc9b45bc341228bcc0f2192040224 Jun 16 16:20:08.210677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:20:08.210677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:20:08.210677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Instance 6776a1f2-1043-4048-99e7-cdc91959fe40 could not be found. Jun 16 16:20:08.210677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': '6776a1f2-1043-4048-99e7-cdc91959fe40'} Jun 16 16:20:08.211538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:20:08.211538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:08.211538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:20:08.211538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:20:08.211538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:20:08.211538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:20:08.211538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:20:08.211538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:20:08.211538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:20:08.211538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:20:08.211538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6776a1f2-1043-4048-99e7-cdc91959fe40 could not be found. Jun 16 16:20:08.211538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:20:08.211538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:08.211538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:20:08.211538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:08.211538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:08.211538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:08.211538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:20:08.211538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:20:08.211538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:20:08.212752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:20:08.212752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:20:08.212752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:20:08.212752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:20:08.212752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:20:08.212752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:20:08.212752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:20:08.212752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6776a1f2-1043-4048-99e7-cdc91959fe40 could not be found. Jun 16 16:20:08.212752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:20:08.212752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:08.212752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:20:08.212752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:08.212752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:08.212752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:08.212752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:20:08.212752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:20:08.212752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6776a1f2-1043-4048-99e7-cdc91959fe40 could not be found. Jun 16 16:20:08.212752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:20:08.213982 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d243ab95-100b-4152-a477-0af2430194d8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Returning 404 to user: Instance 6776a1f2-1043-4048-99e7-cdc91959fe40 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:20:08.213982 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d243ab95-100b-4152-a477-0af2430194d8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 404 len: 111 microversion: 2.1 time: 0.030470 Jun 16 16:20:08.213982 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 443/887] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:08 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:20:08.219880 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a469259f-be74-4ea5-838a-0b5b533d42f5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '.version_select at 0x7f6f1198bb80>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:08.238730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a469259f-be74-4ea5-838a-0b5b533d42f5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1170520403" status: 202 len: 0 microversion: 2.1 time: 0.023200 Jun 16 16:20:08.239293 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 445/888] 10.222.0.88 () {58 vars in 1220 bytes} [Thu Jun 16 16:20:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1170520403 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:20:08.917644 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0fd511ad-c7fc-47d1-8102-e6363a556e03 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Action: 'create', calling method: .version_select at 0x7f6f0cef93a0>, body: {"keypair": {"name": "tempest-keypair-1672480584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAC6dJ7VpTYKxrFPr+baovA1EAt2rQn+Pg89sFPHESRHQQ6r7qKcn1Ww1Am99Ski+YjVroX5eC3odrlBNclO1wWsYvWJfhsHVpLgYMvjt7Bw2xMeAKX98Va0MmkSy79Pw=="}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:20:08.931322 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-0fd511ad-c7fc-47d1-8102-e6363a556e03 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Getting quotas for project c1cdf363c2e44af5b0d8cd748c58235b. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:20:08.935016 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-0fd511ad-c7fc-47d1-8102-e6363a556e03 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Getting quotas for user bfbcc9b45bc341228bcc0f2192040224 and project c1cdf363c2e44af5b0d8cd748c58235b. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:20:08.957653 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0fd511ad-c7fc-47d1-8102-e6363a556e03 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043829 Jun 16 16:20:08.958270 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 444/889] 10.222.0.88 () {60 vars in 1158 bytes} [Thu Jun 16 16:20:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:09.761468 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e65c5b5a-6956-4fa7-bf29-142b78805dff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:09.762092 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e65c5b5a-6956-4fa7-bf29-142b78805dff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:09.769658 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e65c5b5a-6956-4fa7-bf29-142b78805dff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:09.770139 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e65c5b5a-6956-4fa7-bf29-142b78805dff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:09.770908 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e65c5b5a-6956-4fa7-bf29-142b78805dff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:09.771347 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e65c5b5a-6956-4fa7-bf29-142b78805dff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:09.804279 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e65c5b5a-6956-4fa7-bf29-142b78805dff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970/os-volume_attachments/c1638550-5f9a-4cf5-8eab-4950632b04de" status: 200 len: 194 microversion: 2.20 time: 0.047296 Jun 16 16:20:09.804884 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 446/890] 10.222.0.88 () {60 vars in 1453 bytes} [Thu Jun 16 16:20:09 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970/os-volume_attachments/c1638550-5f9a-4cf5-8eab-4950632b04de => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:20:09.870089 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4daef592-7485-47ba-823c-a82ddae12ca1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:09.870660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4daef592-7485-47ba-823c-a82ddae12ca1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:09.877540 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4daef592-7485-47ba-823c-a82ddae12ca1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:09.878035 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4daef592-7485-47ba-823c-a82ddae12ca1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:09.878849 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4daef592-7485-47ba-823c-a82ddae12ca1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:09.879290 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4daef592-7485-47ba-823c-a82ddae12ca1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:09.962166 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-4daef592-7485-47ba-823c-a82ddae12ca1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lazy-loading 'services' on Instance uuid 31998833-f554-4e9e-8215-6694a9d01970 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:20:10.043527 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4daef592-7485-47ba-823c-a82ddae12ca1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "DELETE /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970/os-volume_attachments/c1638550-5f9a-4cf5-8eab-4950632b04de" status: 202 len: 0 microversion: 2.20 time: 0.177629 Jun 16 16:20:10.046931 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 445/891] 10.222.0.88 () {60 vars in 1456 bytes} [Thu Jun 16 16:20:09 2022] DELETE /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970/os-volume_attachments/c1638550-5f9a-4cf5-8eab-4950632b04de => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:20:10.055210 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4249f4a4-3f48-4e89-ae38-b8ebb5b1dc7d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:10.056435 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4249f4a4-3f48-4e89-ae38-b8ebb5b1dc7d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:10.063674 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4249f4a4-3f48-4e89-ae38-b8ebb5b1dc7d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:10.064363 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4249f4a4-3f48-4e89-ae38-b8ebb5b1dc7d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:10.065410 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4249f4a4-3f48-4e89-ae38-b8ebb5b1dc7d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:10.066060 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4249f4a4-3f48-4e89-ae38-b8ebb5b1dc7d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:10.101076 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4249f4a4-3f48-4e89-ae38-b8ebb5b1dc7d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050678 Jun 16 16:20:10.101652 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 447/892] 10.222.0.88 () {60 vars in 1342 bytes} [Thu Jun 16 16:20:10 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:20:10.499561 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-39c25a25-76ad-4e8e-bba6-3c1cfa23f328 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-802436262", "imageRef": "d2716dc1-3d4d-4f62-b0af-c38986f2a3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4704a63-fabf-4303-b16d-892673b27ab3"}], "security_groups": [{"name": "tempest-securitygroup--1642662389"}], "key_name": "tempest-keypair-1672480584", "user_data": "}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:20:10.604218 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-39c25a25-76ad-4e8e-bba6-3c1cfa23f328 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] validate_networks() for [('b4704a63-fabf-4303-b16d-892673b27ab3', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:20:10.981651 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-39c25a25-76ad-4e8e-bba6-3c1cfa23f328 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:20:10.982747 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-39c25a25-76ad-4e8e-bba6-3c1cfa23f328 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:20:10.983053 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-39c25a25-76ad-4e8e-bba6-3c1cfa23f328 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:20:10.983456 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-39c25a25-76ad-4e8e-bba6-3c1cfa23f328 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:20:10.983864 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-39c25a25-76ad-4e8e-bba6-3c1cfa23f328 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:20:10.992661 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-39c25a25-76ad-4e8e-bba6-3c1cfa23f328 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:10.993106 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-39c25a25-76ad-4e8e-bba6-3c1cfa23f328 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:10.993940 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-39c25a25-76ad-4e8e-bba6-3c1cfa23f328 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:10.994378 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-39c25a25-76ad-4e8e-bba6-3c1cfa23f328 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:11.011154 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-39c25a25-76ad-4e8e-bba6-3c1cfa23f328 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Getting quotas for project c1cdf363c2e44af5b0d8cd748c58235b. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:20:11.015569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-39c25a25-76ad-4e8e-bba6-3c1cfa23f328 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Getting quotas for user bfbcc9b45bc341228bcc0f2192040224 and project c1cdf363c2e44af5b0d8cd748c58235b. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:20:11.026287 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-39c25a25-76ad-4e8e-bba6-3c1cfa23f328 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:20:11.029154 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-39c25a25-76ad-4e8e-bba6-3c1cfa23f328 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2716dc1-3d4d-4f62-b0af-c38986f2a3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:20:11.075539 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-39c25a25-76ad-4e8e-bba6-3c1cfa23f328 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.581089 Jun 16 16:20:11.076217 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 446/893] 10.222.0.88 () {60 vars in 1146 bytes} [Thu Jun 16 16:20:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:20:11.086954 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-02cb5924-46c1-4ab0-b449-c38e0c749b73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:11.087732 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-02cb5924-46c1-4ab0-b449-c38e0c749b73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:11.120475 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0f63a8d8-4770-433f-878f-9774fe4af240 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:11.122057 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0f63a8d8-4770-433f-878f-9774fe4af240 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:11.141751 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0f63a8d8-4770-433f-878f-9774fe4af240 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:11.142225 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0f63a8d8-4770-433f-878f-9774fe4af240 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:11.143217 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0f63a8d8-4770-433f-878f-9774fe4af240 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:11.144429 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0f63a8d8-4770-433f-878f-9774fe4af240 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:11.176477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0f63a8d8-4770-433f-878f-9774fe4af240 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061599 Jun 16 16:20:11.176821 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-02cb5924-46c1-4ab0-b449-c38e0c749b73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:11.180574 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 447/894] 10.222.0.88 () {60 vars in 1342 bytes} [Thu Jun 16 16:20:11 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:20:11.186075 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-02cb5924-46c1-4ab0-b449-c38e0c749b73 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 200 len: 1241 microversion: 2.1 time: 0.103717 Jun 16 16:20:11.186641 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 448/895] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:11 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 1241 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:12.189076 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b7ef8d0a-f46b-4b76-8cd4-20994ca211b8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:12.190294 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b7ef8d0a-f46b-4b76-8cd4-20994ca211b8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:12.197081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b7ef8d0a-f46b-4b76-8cd4-20994ca211b8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:12.197610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b7ef8d0a-f46b-4b76-8cd4-20994ca211b8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:12.198590 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b7ef8d0a-f46b-4b76-8cd4-20994ca211b8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:12.199225 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b7ef8d0a-f46b-4b76-8cd4-20994ca211b8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:12.205335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cee72684-937d-491c-8945-bf239f6d1c42 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:12.206759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-cee72684-937d-491c-8945-bf239f6d1c42 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:12.214623 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cee72684-937d-491c-8945-bf239f6d1c42 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:12.215068 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cee72684-937d-491c-8945-bf239f6d1c42 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:12.215906 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cee72684-937d-491c-8945-bf239f6d1c42 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:12.216344 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cee72684-937d-491c-8945-bf239f6d1c42 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:12.258599 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b7ef8d0a-f46b-4b76-8cd4-20994ca211b8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.074301 Jun 16 16:20:12.261796 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 448/896] 10.222.0.88 () {60 vars in 1342 bytes} [Thu Jun 16 16:20:12 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:12.290616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cee72684-937d-491c-8945-bf239f6d1c42 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:12.299603 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cee72684-937d-491c-8945-bf239f6d1c42 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 200 len: 1311 microversion: 2.1 time: 0.099448 Jun 16 16:20:12.314425 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 449/897] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:12 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:12.325463 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f2db741e-a8b0-4b7c-ada5-6dd3ff508af6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:12.325903 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f2db741e-a8b0-4b7c-ada5-6dd3ff508af6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:12.332733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f2db741e-a8b0-4b7c-ada5-6dd3ff508af6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:12.333183 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f2db741e-a8b0-4b7c-ada5-6dd3ff508af6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:12.333980 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f2db741e-a8b0-4b7c-ada5-6dd3ff508af6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:12.334811 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f2db741e-a8b0-4b7c-ada5-6dd3ff508af6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:12.361601 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f2db741e-a8b0-4b7c-ada5-6dd3ff508af6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:20:12.423195 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:12.440397 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f2db741e-a8b0-4b7c-ada5-6dd3ff508af6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "DELETE /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 204 len: 0 microversion: 2.20 time: 0.118900 Jun 16 16:20:12.440909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 449/898] 10.222.0.88 () {60 vars in 1279 bytes} [Thu Jun 16 16:20:12 2022] DELETE /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 16:20:12.449061 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5e92918b-27a3-40ea-9e01-97ac12809f48 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:12.449656 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5e92918b-27a3-40ea-9e01-97ac12809f48 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:12.456235 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5e92918b-27a3-40ea-9e01-97ac12809f48 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:12.456676 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5e92918b-27a3-40ea-9e01-97ac12809f48 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:12.457426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5e92918b-27a3-40ea-9e01-97ac12809f48 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:12.457913 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5e92918b-27a3-40ea-9e01-97ac12809f48 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:12.667956 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5e92918b-27a3-40ea-9e01-97ac12809f48 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:12.677395 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5e92918b-27a3-40ea-9e01-97ac12809f48 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:12.678942 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5e92918b-27a3-40ea-9e01-97ac12809f48 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:12.680101 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5e92918b-27a3-40ea-9e01-97ac12809f48 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.234940 Jun 16 16:20:12.680665 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 450/899] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:12 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:13.327611 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6b5b6619-cb46-4e41-9d88-f4b7a2512c63 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:13.328317 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6b5b6619-cb46-4e41-9d88-f4b7a2512c63 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:13.335178 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6b5b6619-cb46-4e41-9d88-f4b7a2512c63 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:13.335572 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6b5b6619-cb46-4e41-9d88-f4b7a2512c63 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:13.336547 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6b5b6619-cb46-4e41-9d88-f4b7a2512c63 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:13.336868 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6b5b6619-cb46-4e41-9d88-f4b7a2512c63 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:13.476023 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6b5b6619-cb46-4e41-9d88-f4b7a2512c63 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:13.483978 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6b5b6619-cb46-4e41-9d88-f4b7a2512c63 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 200 len: 1367 microversion: 2.1 time: 0.160523 Jun 16 16:20:13.484541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 450/900] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:13 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:13.698368 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b0f18909-7fcc-4098-bc78-90312a583dcc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:13.698977 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b0f18909-7fcc-4098-bc78-90312a583dcc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:13.705576 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b0f18909-7fcc-4098-bc78-90312a583dcc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:13.706063 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b0f18909-7fcc-4098-bc78-90312a583dcc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:13.706822 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b0f18909-7fcc-4098-bc78-90312a583dcc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:13.707264 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b0f18909-7fcc-4098-bc78-90312a583dcc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:13.849368 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b0f18909-7fcc-4098-bc78-90312a583dcc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:13.857491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b0f18909-7fcc-4098-bc78-90312a583dcc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:13.859025 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b0f18909-7fcc-4098-bc78-90312a583dcc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:13.860165 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b0f18909-7fcc-4098-bc78-90312a583dcc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.165788 Jun 16 16:20:13.860723 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 451/901] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:13 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:20:14.501470 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-157a6294-a00c-44ac-9bd3-213c0a658850 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:14.502143 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-157a6294-a00c-44ac-9bd3-213c0a658850 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:14.508627 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-157a6294-a00c-44ac-9bd3-213c0a658850 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:14.509594 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-157a6294-a00c-44ac-9bd3-213c0a658850 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:14.510473 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-157a6294-a00c-44ac-9bd3-213c0a658850 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:14.510863 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-157a6294-a00c-44ac-9bd3-213c0a658850 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:14.531188 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:14.743718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-157a6294-a00c-44ac-9bd3-213c0a658850 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:14.755185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-157a6294-a00c-44ac-9bd3-213c0a658850 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 200 len: 1367 microversion: 2.1 time: 0.258033 Jun 16 16:20:14.755766 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 451/902] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:14 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:14.854560 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-99b0a020-07a4-4ade-91df-c65a1da4f292 req-a3974612-3eb4-4716-b6f0-8e1fd8f9faae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17331aa3-ceef-4afb-9a61-a7bc981e5fa4", "tag": "e39c301b-1099-43a0-9e6f-cc8fbcf288d7"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:20:14.864210 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-99b0a020-07a4-4ade-91df-c65a1da4f292 req-a3974612-3eb4-4716-b6f0-8e1fd8f9faae service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:14.864664 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-99b0a020-07a4-4ade-91df-c65a1da4f292 req-a3974612-3eb4-4716-b6f0-8e1fd8f9faae service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:14.878522 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-99b0a020-07a4-4ade-91df-c65a1da4f292 req-a3974612-3eb4-4716-b6f0-8e1fd8f9faae service nova] Creating event network-changed:e39c301b-1099-43a0-9e6f-cc8fbcf288d7 for instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 on hv-cinder-83735 Jun 16 16:20:14.882459 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-aaf0c793-2b70-4b43-a670-ff93f99ddb5f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:14.883307 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-aaf0c793-2b70-4b43-a670-ff93f99ddb5f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:14.884067 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-99b0a020-07a4-4ade-91df-c65a1da4f292 req-a3974612-3eb4-4716-b6f0-8e1fd8f9faae service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033209 Jun 16 16:20:14.885894 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 452/903] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:14.891246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aaf0c793-2b70-4b43-a670-ff93f99ddb5f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:14.891698 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aaf0c793-2b70-4b43-a670-ff93f99ddb5f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:14.892475 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aaf0c793-2b70-4b43-a670-ff93f99ddb5f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:14.892911 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aaf0c793-2b70-4b43-a670-ff93f99ddb5f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:15.113862 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-aaf0c793-2b70-4b43-a670-ff93f99ddb5f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:15.122204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-aaf0c793-2b70-4b43-a670-ff93f99ddb5f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:15.124267 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-aaf0c793-2b70-4b43-a670-ff93f99ddb5f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:15.125475 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-aaf0c793-2b70-4b43-a670-ff93f99ddb5f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1723 microversion: 2.20 time: 0.250508 Jun 16 16:20:15.126070 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 452/904] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:14 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:15.773376 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1d7e4885-d2b8-4a8a-925b-f54de3fafb66 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:15.774260 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1d7e4885-d2b8-4a8a-925b-f54de3fafb66 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:15.781547 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1d7e4885-d2b8-4a8a-925b-f54de3fafb66 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:15.782043 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1d7e4885-d2b8-4a8a-925b-f54de3fafb66 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:15.782810 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1d7e4885-d2b8-4a8a-925b-f54de3fafb66 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:15.783251 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1d7e4885-d2b8-4a8a-925b-f54de3fafb66 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:16.029470 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1d7e4885-d2b8-4a8a-925b-f54de3fafb66 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:16.037034 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1d7e4885-d2b8-4a8a-925b-f54de3fafb66 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 200 len: 1367 microversion: 2.1 time: 0.267768 Jun 16 16:20:16.037617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 453/905] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:15 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:16.143704 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-dcfa36e0-c489-42a1-9c56-1ee572e5e28a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:16.144318 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dcfa36e0-c489-42a1-9c56-1ee572e5e28a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:16.151920 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dcfa36e0-c489-42a1-9c56-1ee572e5e28a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:16.152928 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dcfa36e0-c489-42a1-9c56-1ee572e5e28a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:16.154266 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dcfa36e0-c489-42a1-9c56-1ee572e5e28a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:16.154962 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dcfa36e0-c489-42a1-9c56-1ee572e5e28a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:16.490962 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dcfa36e0-c489-42a1-9c56-1ee572e5e28a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:16.500111 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dcfa36e0-c489-42a1-9c56-1ee572e5e28a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:16.501857 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dcfa36e0-c489-42a1-9c56-1ee572e5e28a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:16.503109 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-dcfa36e0-c489-42a1-9c56-1ee572e5e28a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1655 microversion: 2.20 time: 0.363487 Jun 16 16:20:16.503771 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 453/906] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:16 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1655 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:16.900546 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-39504e26-2177-4bb2-82bb-ce146bda427e req-3cece04a-c375-42cd-85ba-cdead15316f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31998833-f554-4e9e-8215-6694a9d01970", "name": "network-vif-deleted", "tag": "45b1ab78-929d-4b1a-90a1-4777fb503a47"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:20:16.909458 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-39504e26-2177-4bb2-82bb-ce146bda427e req-3cece04a-c375-42cd-85ba-cdead15316f0 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:16.910009 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-39504e26-2177-4bb2-82bb-ce146bda427e req-3cece04a-c375-42cd-85ba-cdead15316f0 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:16.924515 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-39504e26-2177-4bb2-82bb-ce146bda427e req-3cece04a-c375-42cd-85ba-cdead15316f0 service nova] Creating event network-vif-deleted:45b1ab78-929d-4b1a-90a1-4777fb503a47 for instance 31998833-f554-4e9e-8215-6694a9d01970 on hv-cinder-83735 Jun 16 16:20:16.929445 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-39504e26-2177-4bb2-82bb-ce146bda427e req-3cece04a-c375-42cd-85ba-cdead15316f0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032601 Jun 16 16:20:16.930105 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 454/907] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:17.054316 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0c3e57cc-bf48-4e1f-819a-879f9b9fd48b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:17.054968 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0c3e57cc-bf48-4e1f-819a-879f9b9fd48b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:17.061278 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0c3e57cc-bf48-4e1f-819a-879f9b9fd48b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:17.061758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0c3e57cc-bf48-4e1f-819a-879f9b9fd48b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:17.062541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0c3e57cc-bf48-4e1f-819a-879f9b9fd48b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:17.062981 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0c3e57cc-bf48-4e1f-819a-879f9b9fd48b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:17.203413 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0c3e57cc-bf48-4e1f-819a-879f9b9fd48b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:17.210862 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0c3e57cc-bf48-4e1f-819a-879f9b9fd48b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 200 len: 1367 microversion: 2.1 time: 0.160462 Jun 16 16:20:17.211441 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 454/908] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:17 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:17.525358 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6323656a-88e8-4303-9e55-c24bdfdee49a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:17.526076 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6323656a-88e8-4303-9e55-c24bdfdee49a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:17.532958 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6323656a-88e8-4303-9e55-c24bdfdee49a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:17.533428 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6323656a-88e8-4303-9e55-c24bdfdee49a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:17.534212 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6323656a-88e8-4303-9e55-c24bdfdee49a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:17.534641 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6323656a-88e8-4303-9e55-c24bdfdee49a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:17.595549 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6323656a-88e8-4303-9e55-c24bdfdee49a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:17.603629 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6323656a-88e8-4303-9e55-c24bdfdee49a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:17.605112 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6323656a-88e8-4303-9e55-c24bdfdee49a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:17.606268 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6323656a-88e8-4303-9e55-c24bdfdee49a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1655 microversion: 2.20 time: 0.085168 Jun 16 16:20:17.607465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 455/909] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:17 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1655 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:18.227821 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-52495b1c-61e6-4dd2-9ff4-cfc7d86e7324 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:18.228432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-52495b1c-61e6-4dd2-9ff4-cfc7d86e7324 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:18.235542 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-52495b1c-61e6-4dd2-9ff4-cfc7d86e7324 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:18.235996 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-52495b1c-61e6-4dd2-9ff4-cfc7d86e7324 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:18.236763 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-52495b1c-61e6-4dd2-9ff4-cfc7d86e7324 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:18.237204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-52495b1c-61e6-4dd2-9ff4-cfc7d86e7324 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:18.363630 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-52495b1c-61e6-4dd2-9ff4-cfc7d86e7324 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:18.371007 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-52495b1c-61e6-4dd2-9ff4-cfc7d86e7324 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 200 len: 1367 microversion: 2.1 time: 0.147116 Jun 16 16:20:18.371573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 455/910] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:18 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:18.625562 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bfbbe790-9eb5-4103-acb7-4bab5411c534 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:18.626188 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-bfbbe790-9eb5-4103-acb7-4bab5411c534 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:18.632674 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bfbbe790-9eb5-4103-acb7-4bab5411c534 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:18.633123 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bfbbe790-9eb5-4103-acb7-4bab5411c534 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:18.633916 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bfbbe790-9eb5-4103-acb7-4bab5411c534 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:18.634357 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bfbbe790-9eb5-4103-acb7-4bab5411c534 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:18.702285 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bfbbe790-9eb5-4103-acb7-4bab5411c534 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:18.710206 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bfbbe790-9eb5-4103-acb7-4bab5411c534 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:18.711709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bfbbe790-9eb5-4103-acb7-4bab5411c534 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:18.712858 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-bfbbe790-9eb5-4103-acb7-4bab5411c534 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 200 len: 1655 microversion: 2.20 time: 0.091750 Jun 16 16:20:18.714180 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 456/911] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:18 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 1655 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:19.388501 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-218e969e-deca-4cab-9e41-63491e3597e7 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:19.389217 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-218e969e-deca-4cab-9e41-63491e3597e7 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:19.395260 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-218e969e-deca-4cab-9e41-63491e3597e7 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:19.395706 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-218e969e-deca-4cab-9e41-63491e3597e7 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:19.396458 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-218e969e-deca-4cab-9e41-63491e3597e7 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:19.396892 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-218e969e-deca-4cab-9e41-63491e3597e7 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:19.614553 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-218e969e-deca-4cab-9e41-63491e3597e7 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:19.622188 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-218e969e-deca-4cab-9e41-63491e3597e7 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 200 len: 1367 microversion: 2.1 time: 0.238652 Jun 16 16:20:19.622757 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 456/912] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:19 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:19.732699 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-518c9634-e0f4-4fab-ae3c-dfbcf062e865 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:19.733420 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-518c9634-e0f4-4fab-ae3c-dfbcf062e865 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:19.739983 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-518c9634-e0f4-4fab-ae3c-dfbcf062e865 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:19.740432 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-518c9634-e0f4-4fab-ae3c-dfbcf062e865 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:19.741187 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-518c9634-e0f4-4fab-ae3c-dfbcf062e865 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:19.741623 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-518c9634-e0f4-4fab-ae3c-dfbcf062e865 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:19.755435 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-518c9634-e0f4-4fab-ae3c-dfbcf062e865 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] HTTP exception thrown: Instance 31998833-f554-4e9e-8215-6694a9d01970 could not be found. Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-518c9634-e0f4-4fab-ae3c-dfbcf062e865 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Request method failure captured: Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 HTTP/1.1 Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1Z1-ipPk7le3oKBdhVjxYdBW03I33ZeyQfIYuNhvWm5TPt4-KR2Bi125tVaJEqjaogWKXHBhrrXughZ7tvdeK1liMiSY5sLtd5mFE2fpKEUug90pw-lBCz8rGyNxfiklySFDtWU70CcXtuDLLUrVpLetQL3OTRdCxCCA9r7l_AgQT4 Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: dbfb390720a54a4eb35c80b0d1a1f16b Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-927768562 Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:20:19.757088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:20:19.758772 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dbfb390720a54a4eb35c80b0d1a1f16b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dbfb390720a54a4eb35c80b0d1a1f16b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_dbfb390720a54a4eb35c80b0d1a1f16b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/dbfb390720a54a4eb35c80b0d1a1f16b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:20:19.758772 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeShelveTestJSON-927768562 Jun 16 16:20:19.758772 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: dbfb390720a54a4eb35c80b0d1a1f16b Jun 16 16:20:19.758772 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-927768562 Jun 16 16:20:19.758772 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeShelveTestJSON-927768562-project Jun 16 16:20:19.758772 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:20:19.758772 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:20:19.758772 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: 46445560ea7e496fa6c9c2e7c9a5b747 Jun 16 16:20:19.758772 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeShelveTestJSON-927768562-project Jun 16 16:20:19.758772 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:20:19.758772 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance 31998833-f554-4e9e-8215-6694a9d01970 could not be found. Jun 16 16:20:19.758772 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '31998833-f554-4e9e-8215-6694a9d01970'} Jun 16 16:20:19.759571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:20:19.759571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:19.759571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:20:19.759571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:20:19.759571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:20:19.759571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:20:19.759571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:20:19.759571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:20:19.759571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:20:19.759571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:20:19.759571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31998833-f554-4e9e-8215-6694a9d01970 could not be found. Jun 16 16:20:19.759571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:20:19.759571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:19.759571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:20:19.759571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:19.759571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:19.759571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:19.759571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:20:19.759571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:20:19.759571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:20:19.760758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:20:19.760758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:20:19.760758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:20:19.760758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:20:19.760758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:20:19.760758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:20:19.760758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:20:19.760758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31998833-f554-4e9e-8215-6694a9d01970 could not be found. Jun 16 16:20:19.760758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:20:19.760758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:20:19.760758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:20:19.760758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:20:19.760758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:20:19.760758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:20:19.760758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:20:19.760758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:20:19.760758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31998833-f554-4e9e-8215-6694a9d01970 could not be found. Jun 16 16:20:19.760758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:20:19.761880 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-518c9634-e0f4-4fab-ae3c-dfbcf062e865 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Returning 404 to user: Instance 31998833-f554-4e9e-8215-6694a9d01970 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:20:19.761880 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-518c9634-e0f4-4fab-ae3c-dfbcf062e865 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 404 len: 111 microversion: 2.20 time: 0.029796 Jun 16 16:20:19.761880 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 457/913] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:19 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:20:19.768120 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d78998d5-dd30-4ada-9c99-be998a1e7194 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '.version_select at 0x7f6f0d167670>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:19.785270 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d78998d5-dd30-4ada-9c99-be998a1e7194 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-979117578" status: 204 len: 0 microversion: 2.20 time: 0.020961 Jun 16 16:20:19.785861 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 457/914] 10.222.0.88 () {60 vars in 1258 bytes} [Thu Jun 16 16:20:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-979117578 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 16:20:20.414551 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cb9bd600-7be4-4211-babd-723ae86ec350 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Action: 'create', calling method: .version_select at 0x7f6f119b8820>, body: {"keypair": {"name": "tempest-keypair-1628242834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHO/ckM205xzxfQCgJ1fsL63RPb+vjIxML8a7uVJjVeBUgElV6BDxlcR+QKb3EHnSmoVtfshXAl9QUFcoa4SVTDEMLCXMNAo9XZTPYJZwL2VIFndmQlVGpM0rv1SOHxfqg=="}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:20:20.418576 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:20.430890 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-cb9bd600-7be4-4211-babd-723ae86ec350 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Getting quotas for project dbfb390720a54a4eb35c80b0d1a1f16b. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:20:20.435217 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-cb9bd600-7be4-4211-babd-723ae86ec350 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Getting quotas for user 46445560ea7e496fa6c9c2e7c9a5b747 and project dbfb390720a54a4eb35c80b0d1a1f16b. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:20:20.456646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cb9bd600-7be4-4211-babd-723ae86ec350 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046346 Jun 16 16:20:20.457141 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 458/915] 10.222.0.88 () {62 vars in 1199 bytes} [Thu Jun 16 16:20:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 16 16:20:20.640144 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b8475eba-74f4-400f-81d7-eef68cb13494 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:20.641556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b8475eba-74f4-400f-81d7-eef68cb13494 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:20.649758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b8475eba-74f4-400f-81d7-eef68cb13494 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:20.650481 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b8475eba-74f4-400f-81d7-eef68cb13494 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:20.651819 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b8475eba-74f4-400f-81d7-eef68cb13494 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:20.652564 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b8475eba-74f4-400f-81d7-eef68cb13494 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:20.820770 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b8475eba-74f4-400f-81d7-eef68cb13494 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:20.828852 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b8475eba-74f4-400f-81d7-eef68cb13494 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 200 len: 1367 microversion: 2.1 time: 0.193488 Jun 16 16:20:20.829994 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 458/916] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:20 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:21.773203 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-445c1b63-5d9a-4dbc-a576-95ff281b967c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2127109173", "imageRef": "d2716dc1-3d4d-4f62-b0af-c38986f2a3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25722f8f-379b-492d-af6a-68efbda1c91b"}], "security_groups": [{"name": "tempest-securitygroup--602967918"}], "key_name": "tempest-keypair-1628242834", "user_data": "}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:20:21.846165 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f770d7e7-0aa7-4967-bb57-90681d8d6337 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:21.846900 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f770d7e7-0aa7-4967-bb57-90681d8d6337 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:21.849048 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:21.849795 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=10 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:21.856313 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f770d7e7-0aa7-4967-bb57-90681d8d6337 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:21.856770 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f770d7e7-0aa7-4967-bb57-90681d8d6337 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:21.857552 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f770d7e7-0aa7-4967-bb57-90681d8d6337 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:21.858020 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f770d7e7-0aa7-4967-bb57-90681d8d6337 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:21.875803 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.network.neutron [None req-445c1b63-5d9a-4dbc-a576-95ff281b967c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] validate_networks() for [('25722f8f-379b-492d-af6a-68efbda1c91b', None, None, None, None, None)] {{(pid=117711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:20:22.071190 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f770d7e7-0aa7-4967-bb57-90681d8d6337 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:22.079568 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f770d7e7-0aa7-4967-bb57-90681d8d6337 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 200 len: 1367 microversion: 2.1 time: 0.237196 Jun 16 16:20:22.080237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 459/917] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:21 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:20:22.357135 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-445c1b63-5d9a-4dbc-a576-95ff281b967c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Flavor limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:20:22.357561 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-445c1b63-5d9a-4dbc-a576-95ff281b967c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Image limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:20:22.358064 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-445c1b63-5d9a-4dbc-a576-95ff281b967c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Flavor pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:20:22.358472 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-445c1b63-5d9a-4dbc-a576-95ff281b967c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Image pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:20:22.358888 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-445c1b63-5d9a-4dbc-a576-95ff281b967c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:20:22.367837 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-445c1b63-5d9a-4dbc-a576-95ff281b967c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:22.368284 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-445c1b63-5d9a-4dbc-a576-95ff281b967c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:22.369303 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-445c1b63-5d9a-4dbc-a576-95ff281b967c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:22.369895 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-445c1b63-5d9a-4dbc-a576-95ff281b967c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:22.386112 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-445c1b63-5d9a-4dbc-a576-95ff281b967c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Getting quotas for project dbfb390720a54a4eb35c80b0d1a1f16b. Resources: {'ram', 'instances', 'cores'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:20:22.390496 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-445c1b63-5d9a-4dbc-a576-95ff281b967c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Getting quotas for user 46445560ea7e496fa6c9c2e7c9a5b747 and project dbfb390720a54a4eb35c80b0d1a1f16b. Resources: {'ram', 'instances', 'cores'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:20:22.401312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-445c1b63-5d9a-4dbc-a576-95ff281b967c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Going to run 1 instances... {{(pid=117711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:20:22.404141 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-445c1b63-5d9a-4dbc-a576-95ff281b967c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2716dc1-3d4d-4f62-b0af-c38986f2a3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:20:22.449599 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-445c1b63-5d9a-4dbc-a576-95ff281b967c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.681233 Jun 16 16:20:22.450776 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 459/918] 10.222.0.88 () {62 vars in 1187 bytes} [Thu Jun 16 16:20:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 16:20:22.460636 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-242a1e59-f783-4df5-bac9-d836372250ac tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:22.461266 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-242a1e59-f783-4df5-bac9-d836372250ac tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:22.514630 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-242a1e59-f783-4df5-bac9-d836372250ac tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:22.522081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-242a1e59-f783-4df5-bac9-d836372250ac tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:22.523735 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-242a1e59-f783-4df5-bac9-d836372250ac tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:22.524988 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-242a1e59-f783-4df5-bac9-d836372250ac tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1282 microversion: 2.20 time: 0.068202 Jun 16 16:20:22.525562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 460/919] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:22 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1282 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:22.911794 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-22afa1ed-531d-44ba-b262-aa7dc56d0bb6 req-88dca3cd-dbda-46a3-bfae-e714b470b8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17331aa3-ceef-4afb-9a61-a7bc981e5fa4", "name": "network-vif-plugged", "status": "completed", "tag": "e39c301b-1099-43a0-9e6f-cc8fbcf288d7"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:20:22.923633 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-22afa1ed-531d-44ba-b262-aa7dc56d0bb6 req-88dca3cd-dbda-46a3-bfae-e714b470b8d7 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:22.924165 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-22afa1ed-531d-44ba-b262-aa7dc56d0bb6 req-88dca3cd-dbda-46a3-bfae-e714b470b8d7 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:22.936006 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-22afa1ed-531d-44ba-b262-aa7dc56d0bb6 req-88dca3cd-dbda-46a3-bfae-e714b470b8d7 service nova] Creating event network-vif-plugged:e39c301b-1099-43a0-9e6f-cc8fbcf288d7 for instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 on hv-cinder-83735 Jun 16 16:20:22.941311 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-22afa1ed-531d-44ba-b262-aa7dc56d0bb6 req-88dca3cd-dbda-46a3-bfae-e714b470b8d7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033736 Jun 16 16:20:22.942821 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 460/920] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:23.097181 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-673bb447-6a4f-4577-ba5e-b0c9ed20d9a4 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:23.098081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-673bb447-6a4f-4577-ba5e-b0c9ed20d9a4 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:23.105567 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-673bb447-6a4f-4577-ba5e-b0c9ed20d9a4 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:23.107074 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-673bb447-6a4f-4577-ba5e-b0c9ed20d9a4 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:23.108783 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-673bb447-6a4f-4577-ba5e-b0c9ed20d9a4 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:23.109361 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-673bb447-6a4f-4577-ba5e-b0c9ed20d9a4 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:23.244974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-673bb447-6a4f-4577-ba5e-b0c9ed20d9a4 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:23.252970 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-673bb447-6a4f-4577-ba5e-b0c9ed20d9a4 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 200 len: 1367 microversion: 2.1 time: 0.159997 Jun 16 16:20:23.253528 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 461/921] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:23 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:23.544436 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-431afc3a-03e2-46fb-be74-0ff829c1b475 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:23.545170 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-431afc3a-03e2-46fb-be74-0ff829c1b475 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:23.551736 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-431afc3a-03e2-46fb-be74-0ff829c1b475 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:23.552263 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-431afc3a-03e2-46fb-be74-0ff829c1b475 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:23.553110 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-431afc3a-03e2-46fb-be74-0ff829c1b475 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:23.553562 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-431afc3a-03e2-46fb-be74-0ff829c1b475 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:23.678806 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-431afc3a-03e2-46fb-be74-0ff829c1b475 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:23.687815 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-431afc3a-03e2-46fb-be74-0ff829c1b475 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:23.689372 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-431afc3a-03e2-46fb-be74-0ff829c1b475 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:23.690526 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-431afc3a-03e2-46fb-be74-0ff829c1b475 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1342 microversion: 2.20 time: 0.151059 Jun 16 16:20:23.691267 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 461/922] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:23 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1342 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:24.269459 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-13b26de0-54ab-4c97-8184-b1e7fc8a432a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:24.271744 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-13b26de0-54ab-4c97-8184-b1e7fc8a432a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:24.282751 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-13b26de0-54ab-4c97-8184-b1e7fc8a432a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:24.283203 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-13b26de0-54ab-4c97-8184-b1e7fc8a432a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:24.283973 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-13b26de0-54ab-4c97-8184-b1e7fc8a432a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:24.284407 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-13b26de0-54ab-4c97-8184-b1e7fc8a432a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:24.415061 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-13b26de0-54ab-4c97-8184-b1e7fc8a432a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:24.423091 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-13b26de0-54ab-4c97-8184-b1e7fc8a432a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 200 len: 1367 microversion: 2.1 time: 0.157643 Jun 16 16:20:24.423676 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 462/923] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:24 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:24.710501 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e143b6b0-8952-42ad-8417-4bd87170eaa8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:24.711120 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e143b6b0-8952-42ad-8417-4bd87170eaa8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:24.718153 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e143b6b0-8952-42ad-8417-4bd87170eaa8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:24.718604 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e143b6b0-8952-42ad-8417-4bd87170eaa8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:24.719473 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e143b6b0-8952-42ad-8417-4bd87170eaa8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:24.719902 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e143b6b0-8952-42ad-8417-4bd87170eaa8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:24.814298 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e143b6b0-8952-42ad-8417-4bd87170eaa8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:24.822331 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e143b6b0-8952-42ad-8417-4bd87170eaa8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:24.823827 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e143b6b0-8952-42ad-8417-4bd87170eaa8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:24.825443 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e143b6b0-8952-42ad-8417-4bd87170eaa8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1340 microversion: 2.20 time: 0.118675 Jun 16 16:20:24.826043 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 462/924] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:24 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1340 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:25.440474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-34df3c81-43b6-4663-b959-7d3a8f6bb5a6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:25.441100 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-34df3c81-43b6-4663-b959-7d3a8f6bb5a6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:25.448236 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-34df3c81-43b6-4663-b959-7d3a8f6bb5a6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:25.448236 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-34df3c81-43b6-4663-b959-7d3a8f6bb5a6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:25.448917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-34df3c81-43b6-4663-b959-7d3a8f6bb5a6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:25.449354 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-34df3c81-43b6-4663-b959-7d3a8f6bb5a6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:25.671559 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-34df3c81-43b6-4663-b959-7d3a8f6bb5a6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:25.685493 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-34df3c81-43b6-4663-b959-7d3a8f6bb5a6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 200 len: 1367 microversion: 2.1 time: 0.247882 Jun 16 16:20:25.687956 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 463/925] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:25 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:25.810767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-7ac4de70-b6b1-4238-9beb-a7978d79d8d5 req-b91549ef-f1b4-47b7-883a-8acb3253e07e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38f151b6-bfce-4c42-932f-7be72f7da4b4", "tag": "44d3a737-8fd0-480a-b4eb-2bc5eb327a3f"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:20:25.819398 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-7ac4de70-b6b1-4238-9beb-a7978d79d8d5 req-b91549ef-f1b4-47b7-883a-8acb3253e07e service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:25.819868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-7ac4de70-b6b1-4238-9beb-a7978d79d8d5 req-b91549ef-f1b4-47b7-883a-8acb3253e07e service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:25.824083 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:25.833477 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-7ac4de70-b6b1-4238-9beb-a7978d79d8d5 req-b91549ef-f1b4-47b7-883a-8acb3253e07e service nova] Creating event network-changed:44d3a737-8fd0-480a-b4eb-2bc5eb327a3f for instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 on hv-cinder-83735 Jun 16 16:20:25.841362 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-7ac4de70-b6b1-4238-9beb-a7978d79d8d5 req-b91549ef-f1b4-47b7-883a-8acb3253e07e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034256 Jun 16 16:20:25.841912 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 463/926] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:25.843887 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fd2936ef-0cb1-4213-af00-7dda2e881f25 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:25.844502 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fd2936ef-0cb1-4213-af00-7dda2e881f25 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:25.850865 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fd2936ef-0cb1-4213-af00-7dda2e881f25 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:25.851331 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fd2936ef-0cb1-4213-af00-7dda2e881f25 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:25.852108 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fd2936ef-0cb1-4213-af00-7dda2e881f25 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:25.852543 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fd2936ef-0cb1-4213-af00-7dda2e881f25 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:25.989825 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-fd2936ef-0cb1-4213-af00-7dda2e881f25 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:25.997813 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-fd2936ef-0cb1-4213-af00-7dda2e881f25 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:25.999328 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-fd2936ef-0cb1-4213-af00-7dda2e881f25 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:26.000430 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fd2936ef-0cb1-4213-af00-7dda2e881f25 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1407 microversion: 2.20 time: 0.160706 Jun 16 16:20:26.000992 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 464/927] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:25 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:20:26.705730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c231d3dc-3171-4ac1-86ad-ebca76cac95a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:26.706484 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c231d3dc-3171-4ac1-86ad-ebca76cac95a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:26.712835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c231d3dc-3171-4ac1-86ad-ebca76cac95a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:26.713287 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c231d3dc-3171-4ac1-86ad-ebca76cac95a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:26.714076 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c231d3dc-3171-4ac1-86ad-ebca76cac95a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:26.714518 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c231d3dc-3171-4ac1-86ad-ebca76cac95a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:26.919465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c231d3dc-3171-4ac1-86ad-ebca76cac95a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:26.928821 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c231d3dc-3171-4ac1-86ad-ebca76cac95a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 200 len: 1557 microversion: 2.1 time: 0.227317 Jun 16 16:20:26.929808 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 464/928] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:20:26 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 1557 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:20:26.948008 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7be6a069-aee3-4502-bed5-dfa821fefa11 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:26.948629 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7be6a069-aee3-4502-bed5-dfa821fefa11 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:26.955479 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7be6a069-aee3-4502-bed5-dfa821fefa11 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:26.955951 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7be6a069-aee3-4502-bed5-dfa821fefa11 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:26.956704 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7be6a069-aee3-4502-bed5-dfa821fefa11 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:26.957172 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7be6a069-aee3-4502-bed5-dfa821fefa11 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:27.018688 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5ab2d6d3-3831-473c-a92a-42a878ca301f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:27.019355 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5ab2d6d3-3831-473c-a92a-42a878ca301f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:27.025439 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5ab2d6d3-3831-473c-a92a-42a878ca301f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:27.025938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5ab2d6d3-3831-473c-a92a-42a878ca301f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:27.026714 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5ab2d6d3-3831-473c-a92a-42a878ca301f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:27.027155 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5ab2d6d3-3831-473c-a92a-42a878ca301f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:27.086303 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7be6a069-aee3-4502-bed5-dfa821fefa11 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.141607 Jun 16 16:20:27.092943 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 465/929] 10.222.0.88 () {58 vars in 1274 bytes} [Thu Jun 16 16:20:26 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:27.227435 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5ab2d6d3-3831-473c-a92a-42a878ca301f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:27.235560 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5ab2d6d3-3831-473c-a92a-42a878ca301f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:27.237158 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5ab2d6d3-3831-473c-a92a-42a878ca301f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:27.238337 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5ab2d6d3-3831-473c-a92a-42a878ca301f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1407 microversion: 2.20 time: 0.223623 Jun 16 16:20:27.239784 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 465/930] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:27 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:20:28.256797 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bd9840b0-7e46-4d1b-8018-631d3397626d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:28.258267 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-bd9840b0-7e46-4d1b-8018-631d3397626d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:28.264494 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bd9840b0-7e46-4d1b-8018-631d3397626d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:28.264936 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bd9840b0-7e46-4d1b-8018-631d3397626d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:28.265689 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bd9840b0-7e46-4d1b-8018-631d3397626d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:28.266145 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bd9840b0-7e46-4d1b-8018-631d3397626d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:28.275364 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-c8d299ca-1b24-4cb6-ab5f-73e22cc58bc9 req-76d4fa7e-76c0-4511-ba93-a7fc2cc22aaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17331aa3-ceef-4afb-9a61-a7bc981e5fa4", "tag": "e39c301b-1099-43a0-9e6f-cc8fbcf288d7"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:20:28.284474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-c8d299ca-1b24-4cb6-ab5f-73e22cc58bc9 req-76d4fa7e-76c0-4511-ba93-a7fc2cc22aaf service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:28.284932 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-c8d299ca-1b24-4cb6-ab5f-73e22cc58bc9 req-76d4fa7e-76c0-4511-ba93-a7fc2cc22aaf service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:28.297238 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-c8d299ca-1b24-4cb6-ab5f-73e22cc58bc9 req-76d4fa7e-76c0-4511-ba93-a7fc2cc22aaf service nova] Creating event network-changed:e39c301b-1099-43a0-9e6f-cc8fbcf288d7 for instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 on hv-cinder-83735 Jun 16 16:20:28.302442 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-c8d299ca-1b24-4cb6-ab5f-73e22cc58bc9 req-76d4fa7e-76c0-4511-ba93-a7fc2cc22aaf service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103492 Jun 16 16:20:28.303047 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 466/931] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:28.407350 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bd9840b0-7e46-4d1b-8018-631d3397626d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:28.415355 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bd9840b0-7e46-4d1b-8018-631d3397626d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:28.416882 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bd9840b0-7e46-4d1b-8018-631d3397626d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:28.418053 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-bd9840b0-7e46-4d1b-8018-631d3397626d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1407 microversion: 2.20 time: 0.165454 Jun 16 16:20:28.418612 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 466/932] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:28 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:29.438225 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-bb662284-e229-48d7-b1b8-8ccabd5373e5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:29.438848 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-bb662284-e229-48d7-b1b8-8ccabd5373e5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:29.445357 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bb662284-e229-48d7-b1b8-8ccabd5373e5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:29.445915 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bb662284-e229-48d7-b1b8-8ccabd5373e5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:29.446647 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bb662284-e229-48d7-b1b8-8ccabd5373e5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:29.447085 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bb662284-e229-48d7-b1b8-8ccabd5373e5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:29.825233 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-bb662284-e229-48d7-b1b8-8ccabd5373e5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:29.833124 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-bb662284-e229-48d7-b1b8-8ccabd5373e5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:29.834725 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-bb662284-e229-48d7-b1b8-8ccabd5373e5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:29.835831 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-bb662284-e229-48d7-b1b8-8ccabd5373e5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1407 microversion: 2.20 time: 0.403085 Jun 16 16:20:29.836392 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 467/933] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:29 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:30.853828 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-37124b75-c97d-4676-a702-1881c5756126 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:30.854432 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-37124b75-c97d-4676-a702-1881c5756126 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:30.861532 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-37124b75-c97d-4676-a702-1881c5756126 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:30.862009 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-37124b75-c97d-4676-a702-1881c5756126 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:30.862763 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-37124b75-c97d-4676-a702-1881c5756126 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:30.863195 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-37124b75-c97d-4676-a702-1881c5756126 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:31.033383 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-37124b75-c97d-4676-a702-1881c5756126 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:31.041616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-37124b75-c97d-4676-a702-1881c5756126 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:31.043149 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-37124b75-c97d-4676-a702-1881c5756126 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:31.044781 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-37124b75-c97d-4676-a702-1881c5756126 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1407 microversion: 2.20 time: 0.194989 Jun 16 16:20:31.045337 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 467/934] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:30 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:32.063237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-140e64f9-cce4-4b84-b6d7-4129e103cbd6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:32.063842 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-140e64f9-cce4-4b84-b6d7-4129e103cbd6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:32.070439 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-140e64f9-cce4-4b84-b6d7-4129e103cbd6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:32.070872 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-140e64f9-cce4-4b84-b6d7-4129e103cbd6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:32.071655 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-140e64f9-cce4-4b84-b6d7-4129e103cbd6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:32.072085 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-140e64f9-cce4-4b84-b6d7-4129e103cbd6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:32.208156 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-140e64f9-cce4-4b84-b6d7-4129e103cbd6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:32.216606 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-140e64f9-cce4-4b84-b6d7-4129e103cbd6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:32.218112 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-140e64f9-cce4-4b84-b6d7-4129e103cbd6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:32.219209 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-140e64f9-cce4-4b84-b6d7-4129e103cbd6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1407 microversion: 2.20 time: 0.159889 Jun 16 16:20:32.219760 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 468/935] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:32 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:33.237073 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fc9bb3b0-338c-4f6e-94cd-1483239ef0ce tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:33.237682 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fc9bb3b0-338c-4f6e-94cd-1483239ef0ce tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:33.239676 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:33.240338 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=12 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:33.246039 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fc9bb3b0-338c-4f6e-94cd-1483239ef0ce tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:33.247051 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fc9bb3b0-338c-4f6e-94cd-1483239ef0ce tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:33.247801 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fc9bb3b0-338c-4f6e-94cd-1483239ef0ce tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:33.248228 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fc9bb3b0-338c-4f6e-94cd-1483239ef0ce tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:33.375653 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fc9bb3b0-338c-4f6e-94cd-1483239ef0ce tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:33.383727 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fc9bb3b0-338c-4f6e-94cd-1483239ef0ce tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:33.385321 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fc9bb3b0-338c-4f6e-94cd-1483239ef0ce tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:33.386563 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fc9bb3b0-338c-4f6e-94cd-1483239ef0ce tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1407 microversion: 2.20 time: 0.153591 Jun 16 16:20:33.387695 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 468/936] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:33 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:34.405088 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-efbca8b2-b0a6-4e4c-8a51-2706575436e8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:34.405605 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-efbca8b2-b0a6-4e4c-8a51-2706575436e8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:34.407598 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:34.413706 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-efbca8b2-b0a6-4e4c-8a51-2706575436e8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:34.414191 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-efbca8b2-b0a6-4e4c-8a51-2706575436e8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:34.414961 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-efbca8b2-b0a6-4e4c-8a51-2706575436e8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:34.415500 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-efbca8b2-b0a6-4e4c-8a51-2706575436e8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:34.545176 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-efbca8b2-b0a6-4e4c-8a51-2706575436e8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:34.553349 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-efbca8b2-b0a6-4e4c-8a51-2706575436e8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:34.554874 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-efbca8b2-b0a6-4e4c-8a51-2706575436e8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:34.555961 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-efbca8b2-b0a6-4e4c-8a51-2706575436e8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1407 microversion: 2.20 time: 0.155476 Jun 16 16:20:34.556522 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 469/937] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:34 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:35.102142 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-ccf7fcd9-df5f-4e0c-8463-1827ae351212 req-22ed0d7c-bf97-42fe-aead-82c09688f879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f151b6-bfce-4c42-932f-7be72f7da4b4", "name": "network-vif-plugged", "status": "completed", "tag": "44d3a737-8fd0-480a-b4eb-2bc5eb327a3f"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:20:35.111781 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-ccf7fcd9-df5f-4e0c-8463-1827ae351212 req-22ed0d7c-bf97-42fe-aead-82c09688f879 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:35.112205 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-ccf7fcd9-df5f-4e0c-8463-1827ae351212 req-22ed0d7c-bf97-42fe-aead-82c09688f879 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:35.125945 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-ccf7fcd9-df5f-4e0c-8463-1827ae351212 req-22ed0d7c-bf97-42fe-aead-82c09688f879 service nova] Creating event network-vif-plugged:44d3a737-8fd0-480a-b4eb-2bc5eb327a3f for instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 on hv-cinder-83735 Jun 16 16:20:35.134820 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-ccf7fcd9-df5f-4e0c-8463-1827ae351212 req-22ed0d7c-bf97-42fe-aead-82c09688f879 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033083 Jun 16 16:20:35.134820 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 469/938] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:20:35.573770 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8f619871-9560-4799-86fe-57dc48a70524 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:35.574401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8f619871-9560-4799-86fe-57dc48a70524 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:35.581515 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8f619871-9560-4799-86fe-57dc48a70524 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:35.581996 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8f619871-9560-4799-86fe-57dc48a70524 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:35.582809 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8f619871-9560-4799-86fe-57dc48a70524 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:35.583238 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8f619871-9560-4799-86fe-57dc48a70524 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:35.716449 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8f619871-9560-4799-86fe-57dc48a70524 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:35.724519 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8f619871-9560-4799-86fe-57dc48a70524 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:35.726032 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8f619871-9560-4799-86fe-57dc48a70524 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:35.727158 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8f619871-9560-4799-86fe-57dc48a70524 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1407 microversion: 2.20 time: 0.157328 Jun 16 16:20:35.727707 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 470/939] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:35 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:36.746638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0ff4856f-5ebf-4e76-8814-115ad19c889a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:36.747335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0ff4856f-5ebf-4e76-8814-115ad19c889a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:36.753453 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0ff4856f-5ebf-4e76-8814-115ad19c889a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:36.753944 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0ff4856f-5ebf-4e76-8814-115ad19c889a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:36.754700 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0ff4856f-5ebf-4e76-8814-115ad19c889a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:36.755138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0ff4856f-5ebf-4e76-8814-115ad19c889a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:36.941588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0ff4856f-5ebf-4e76-8814-115ad19c889a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:36.950029 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0ff4856f-5ebf-4e76-8814-115ad19c889a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:36.951612 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0ff4856f-5ebf-4e76-8814-115ad19c889a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:36.952715 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0ff4856f-5ebf-4e76-8814-115ad19c889a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1407 microversion: 2.20 time: 0.210925 Jun 16 16:20:36.953270 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 470/940] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:36 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:37.971144 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2f8600c4-5d03-4efb-be7e-94f085612495 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:37.971759 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2f8600c4-5d03-4efb-be7e-94f085612495 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:37.978659 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2f8600c4-5d03-4efb-be7e-94f085612495 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:37.979117 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2f8600c4-5d03-4efb-be7e-94f085612495 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:37.979891 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2f8600c4-5d03-4efb-be7e-94f085612495 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:37.980332 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2f8600c4-5d03-4efb-be7e-94f085612495 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:37.985120 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=100 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:38.127799 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2f8600c4-5d03-4efb-be7e-94f085612495 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:38.137313 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2f8600c4-5d03-4efb-be7e-94f085612495 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:38.138856 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2f8600c4-5d03-4efb-be7e-94f085612495 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:20:38.140039 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2f8600c4-5d03-4efb-be7e-94f085612495 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1600 microversion: 2.20 time: 0.172861 Jun 16 16:20:38.140594 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 471/941] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:20:37 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1600 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:20:38.157649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0225ec6b-a59c-4644-88b6-17f21a326ffe tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:20:38.158303 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0225ec6b-a59c-4644-88b6-17f21a326ffe tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:20:38.164647 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0225ec6b-a59c-4644-88b6-17f21a326ffe tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:38.165087 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0225ec6b-a59c-4644-88b6-17f21a326ffe tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:38.165865 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0225ec6b-a59c-4644-88b6-17f21a326ffe tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:38.166300 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0225ec6b-a59c-4644-88b6-17f21a326ffe tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:38.242848 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0225ec6b-a59c-4644-88b6-17f21a326ffe tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088962 Jun 16 16:20:38.243448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 471/942] 10.222.0.88 () {60 vars in 1315 bytes} [Thu Jun 16 16:20:38 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:20:39.144308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-466236cd-b4d5-42f9-9ba4-6f6d15723681 req-2918fcfd-8d51-4164-9329-e2dbc3bc10ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38f151b6-bfce-4c42-932f-7be72f7da4b4", "tag": "44d3a737-8fd0-480a-b4eb-2bc5eb327a3f"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:20:39.152938 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-466236cd-b4d5-42f9-9ba4-6f6d15723681 req-2918fcfd-8d51-4164-9329-e2dbc3bc10ef service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:20:39.153388 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-466236cd-b4d5-42f9-9ba4-6f6d15723681 req-2918fcfd-8d51-4164-9329-e2dbc3bc10ef service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:20:39.164176 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-466236cd-b4d5-42f9-9ba4-6f6d15723681 req-2918fcfd-8d51-4164-9329-e2dbc3bc10ef service nova] Creating event network-changed:44d3a737-8fd0-480a-b4eb-2bc5eb327a3f for instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 on hv-cinder-83735 Jun 16 16:20:39.170604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-466236cd-b4d5-42f9-9ba4-6f6d15723681 req-2918fcfd-8d51-4164-9329-e2dbc3bc10ef service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029966 Jun 16 16:20:39.172574 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 472/943] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:02.796810 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=4 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:02.797953 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=42 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:02.905784 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0edfdc9a-db52-4292-b29a-2858281dcb7e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1792347776"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:02.906331 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0edfdc9a-db52-4292-b29a-2858281dcb7e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:02.912442 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0edfdc9a-db52-4292-b29a-2858281dcb7e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:02.912892 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0edfdc9a-db52-4292-b29a-2858281dcb7e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:02.913684 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0edfdc9a-db52-4292-b29a-2858281dcb7e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:02.914144 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0edfdc9a-db52-4292-b29a-2858281dcb7e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:03.040717 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.network.security_group_api [None req-0edfdc9a-db52-4292-b29a-2858281dcb7e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Removing security group 74eac6b2-6dfb-4da7-a773-5d20beb6c965 from port fad2c47a-ebb1-49bb-9bf9-18b302cdf9ab Jun 16 16:21:03.384760 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0edfdc9a-db52-4292-b29a-2858281dcb7e tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "POST /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d/action" status: 202 len: 0 microversion: 2.1 time: 0.589671 Jun 16 16:21:03.386962 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 472/944] 10.222.0.88 () {60 vars in 1277 bytes} [Thu Jun 16 16:21:02 2022] POST /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:21:03.393249 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:03.394033 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=6 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:03.398890 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-e6e6cfdd-990d-4cf1-87d2-39924dddcf90 req-b9cfa83f-239d-4be0-a9b5-8a29fa8e291e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "487bea5d-3ad7-4404-9b92-e6b60bc9cf2d", "tag": "fad2c47a-ebb1-49bb-9bf9-18b302cdf9ab"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:03.411609 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-e6e6cfdd-990d-4cf1-87d2-39924dddcf90 req-b9cfa83f-239d-4be0-a9b5-8a29fa8e291e service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:03.412057 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-e6e6cfdd-990d-4cf1-87d2-39924dddcf90 req-b9cfa83f-239d-4be0-a9b5-8a29fa8e291e service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:03.424605 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-e6e6cfdd-990d-4cf1-87d2-39924dddcf90 req-b9cfa83f-239d-4be0-a9b5-8a29fa8e291e service nova] Creating event network-changed:fad2c47a-ebb1-49bb-9bf9-18b302cdf9ab for instance 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d on hv-cinder-83735 Jun 16 16:21:03.430447 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-e6e6cfdd-990d-4cf1-87d2-39924dddcf90 req-b9cfa83f-239d-4be0-a9b5-8a29fa8e291e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039992 Jun 16 16:21:03.431253 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 473/945] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:05.033611 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-98784763-d5e2-4df9-b371-f46e3de7466b tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:05.034202 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-98784763-d5e2-4df9-b371-f46e3de7466b tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:05.040165 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-98784763-d5e2-4df9-b371-f46e3de7466b tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:05.040614 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-98784763-d5e2-4df9-b371-f46e3de7466b tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:05.041368 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-98784763-d5e2-4df9-b371-f46e3de7466b tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:05.041912 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-98784763-d5e2-4df9-b371-f46e3de7466b tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:05.169711 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-98784763-d5e2-4df9-b371-f46e3de7466b tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lazy-loading 'services' on Instance uuid 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:21:05.285105 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-98784763-d5e2-4df9-b371-f46e3de7466b tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "DELETE /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d/os-volume_attachments/611e1049-9ca2-4a3b-9dfa-4ac787f70a15" status: 202 len: 0 microversion: 2.1 time: 0.255710 Jun 16 16:21:05.285853 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 473/946] 10.222.0.88 () {58 vars in 1415 bytes} [Thu Jun 16 16:21:05 2022] DELETE /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d/os-volume_attachments/611e1049-9ca2-4a3b-9dfa-4ac787f70a15 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:21:05.295509 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-209c9c86-b4f6-425c-98d2-95783d84a466 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:05.296576 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-209c9c86-b4f6-425c-98d2-95783d84a466 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:05.303091 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-209c9c86-b4f6-425c-98d2-95783d84a466 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:05.303670 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-209c9c86-b4f6-425c-98d2-95783d84a466 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:05.304519 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-209c9c86-b4f6-425c-98d2-95783d84a466 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:05.304948 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-209c9c86-b4f6-425c-98d2-95783d84a466 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:05.335205 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-209c9c86-b4f6-425c-98d2-95783d84a466 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044963 Jun 16 16:21:05.335773 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 474/947] 10.222.0.88 () {58 vars in 1301 bytes} [Thu Jun 16 16:21:05 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:05.454688 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-b9581b0f-b7c3-411f-89bc-c4a580a12e69 req-f2ce772c-90a4-43a8-a380-03feb6739cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "487bea5d-3ad7-4404-9b92-e6b60bc9cf2d", "tag": "fad2c47a-ebb1-49bb-9bf9-18b302cdf9ab"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:05.463116 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-b9581b0f-b7c3-411f-89bc-c4a580a12e69 req-f2ce772c-90a4-43a8-a380-03feb6739cd5 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:05.463560 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-b9581b0f-b7c3-411f-89bc-c4a580a12e69 req-f2ce772c-90a4-43a8-a380-03feb6739cd5 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:05.475020 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-b9581b0f-b7c3-411f-89bc-c4a580a12e69 req-f2ce772c-90a4-43a8-a380-03feb6739cd5 service nova] Creating event network-changed:fad2c47a-ebb1-49bb-9bf9-18b302cdf9ab for instance 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d on hv-cinder-83735 Jun 16 16:21:05.480579 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-b9581b0f-b7c3-411f-89bc-c4a580a12e69 req-f2ce772c-90a4-43a8-a380-03feb6739cd5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029267 Jun 16 16:21:05.481178 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 474/948] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:06.346277 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-06362975-0fe6-4f6b-a544-ef9f1fd8be40 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:06.347202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-06362975-0fe6-4f6b-a544-ef9f1fd8be40 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:06.354069 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-06362975-0fe6-4f6b-a544-ef9f1fd8be40 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:06.354356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-06362975-0fe6-4f6b-a544-ef9f1fd8be40 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:06.355255 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-06362975-0fe6-4f6b-a544-ef9f1fd8be40 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:06.356204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-06362975-0fe6-4f6b-a544-ef9f1fd8be40 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:06.385229 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-06362975-0fe6-4f6b-a544-ef9f1fd8be40 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043007 Jun 16 16:21:06.391138 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 475/949] 10.222.0.88 () {58 vars in 1301 bytes} [Thu Jun 16 16:21:06 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:07.399834 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7b5f0cd9-1152-4057-972c-d52844395905 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:07.400770 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7b5f0cd9-1152-4057-972c-d52844395905 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:07.408076 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7b5f0cd9-1152-4057-972c-d52844395905 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:07.408520 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7b5f0cd9-1152-4057-972c-d52844395905 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:07.409263 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7b5f0cd9-1152-4057-972c-d52844395905 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:07.409690 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7b5f0cd9-1152-4057-972c-d52844395905 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:07.437014 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7b5f0cd9-1152-4057-972c-d52844395905 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041717 Jun 16 16:21:07.437562 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 475/950] 10.222.0.88 () {58 vars in 1301 bytes} [Thu Jun 16 16:21:07 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:21:07.447356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7b22e182-3a97-4bbb-8727-4ac7ac44d6a9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:07.447878 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7b22e182-3a97-4bbb-8727-4ac7ac44d6a9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:07.454822 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7b22e182-3a97-4bbb-8727-4ac7ac44d6a9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:07.455276 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7b22e182-3a97-4bbb-8727-4ac7ac44d6a9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:07.456038 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7b22e182-3a97-4bbb-8727-4ac7ac44d6a9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:07.456475 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7b22e182-3a97-4bbb-8727-4ac7ac44d6a9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:07.530423 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-7b22e182-3a97-4bbb-8727-4ac7ac44d6a9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] HTTP exception thrown: Instance 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d is not attached to volume 611e1049-9ca2-4a3b-9dfa-4ac787f70a15 Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7b22e182-3a97-4bbb-8727-4ac7ac44d6a9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Request method failure captured: Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: DELETE /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d/os-volume_attachments/611e1049-9ca2-4a3b-9dfa-4ac787f70a15 HTTP/1.1 Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1cplhhlu6g4MT-GZ4IeFczAMkqPsiLX9LJKAbiOHnOXl6ZF0_IZIW-4Kvj0hh9kdiWHSpFvuTCLEBOlT5hV-tTqn4k8DqsM5OzEyLj42IyJq2zWkjulFY6bq9mb3fK4npvrvvSynht_0_NP7W6wCAwyyxqrM1tlMM9gjZlj9ZbvL4c Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: 731df982fd964de6bc4545103f7e1047 Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-TestMinimumBasicScenario-337610725 Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:21:07.532748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:21:07.534396 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/731df982fd964de6bc4545103f7e1047"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/731df982fd964de6bc4545103f7e1047"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_731df982fd964de6bc4545103f7e1047", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/731df982fd964de6bc4545103f7e1047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:21:07.534396 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-TestMinimumBasicScenario-337610725 Jun 16 16:21:07.534396 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 731df982fd964de6bc4545103f7e1047 Jun 16 16:21:07.534396 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-TestMinimumBasicScenario-337610725 Jun 16 16:21:07.534396 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-TestMinimumBasicScenario-337610725-project Jun 16 16:21:07.534396 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:21:07.534396 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:21:07.534396 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: 6e097835e6604a02a38b291786033f06 Jun 16 16:21:07.534396 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-TestMinimumBasicScenario-337610725-project Jun 16 16:21:07.534396 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:21:07.534396 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Instance 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d is not attached to volume 611e1049-9ca2-4a3b-9dfa-4ac787f70a15 Jun 16 16:21:07.535289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'server_id': '487bea5d-3ad7-4404-9b92-e6b60bc9cf2d', 'id': '611e1049-9ca2-4a3b-9dfa-4ac787f70a15'} Jun 16 16:21:07.535289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:21:07.535289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:21:07.535289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 16:21:07.535289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 16:21:07.535289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:21:07.535289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:21:07.535289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 16:21:07.535289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 16:21:07.535289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 611e1049-9ca2-4a3b-9dfa-4ac787f70a15. Jun 16 16:21:07.535289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:21:07.535289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:21:07.535289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:21:07.535289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:21:07.535289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:21:07.535289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:21:07.535289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:21:07.535289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:21:07.535289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:21:07.536898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:21:07.536898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 16:21:07.536898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 16:21:07.536898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d is not attached to volume 611e1049-9ca2-4a3b-9dfa-4ac787f70a15 Jun 16 16:21:07.536898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:21:07.536898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:21:07.536898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:21:07.536898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:21:07.536898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:21:07.536898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:21:07.536898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:21:07.536898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:21:07.536898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d is not attached to volume 611e1049-9ca2-4a3b-9dfa-4ac787f70a15 Jun 16 16:21:07.536898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:21:07.536898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7b22e182-3a97-4bbb-8727-4ac7ac44d6a9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Returning 404 to user: Instance 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d is not attached to volume 611e1049-9ca2-4a3b-9dfa-4ac787f70a15 {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:21:07.538162 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7b22e182-3a97-4bbb-8727-4ac7ac44d6a9 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "DELETE /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d/os-volume_attachments/611e1049-9ca2-4a3b-9dfa-4ac787f70a15" status: 404 len: 154 microversion: 2.1 time: 0.090917 Jun 16 16:21:07.538162 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 476/951] 10.222.0.88 () {58 vars in 1415 bytes} [Thu Jun 16 16:21:07 2022] DELETE /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d/os-volume_attachments/611e1049-9ca2-4a3b-9dfa-4ac787f70a15 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:21:08.666393 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1f292ad6-d373-47c2-94c7-2ce79cdc007a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:08.666897 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1f292ad6-d373-47c2-94c7-2ce79cdc007a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:08.673231 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1f292ad6-d373-47c2-94c7-2ce79cdc007a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:08.673671 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1f292ad6-d373-47c2-94c7-2ce79cdc007a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:08.674450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1f292ad6-d373-47c2-94c7-2ce79cdc007a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:08.674876 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1f292ad6-d373-47c2-94c7-2ce79cdc007a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:08.699524 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1f292ad6-d373-47c2-94c7-2ce79cdc007a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:21:08.775813 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1f292ad6-d373-47c2-94c7-2ce79cdc007a tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "DELETE /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 204 len: 0 microversion: 2.1 time: 0.112882 Jun 16 16:21:08.776404 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 476/952] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:21:08 2022] DELETE /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:21:08.786046 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9c5cd9aa-69e6-428a-9666-46a695ce4a96 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:08.786667 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9c5cd9aa-69e6-428a-9666-46a695ce4a96 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:08.793895 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c5cd9aa-69e6-428a-9666-46a695ce4a96 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:08.793895 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c5cd9aa-69e6-428a-9666-46a695ce4a96 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:08.794714 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c5cd9aa-69e6-428a-9666-46a695ce4a96 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:08.794985 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c5cd9aa-69e6-428a-9666-46a695ce4a96 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:08.928570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9c5cd9aa-69e6-428a-9666-46a695ce4a96 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:08.936550 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9c5cd9aa-69e6-428a-9666-46a695ce4a96 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1555 microversion: 2.1 time: 0.155617 Jun 16 16:21:08.937106 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 477/953] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:08 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:09.954912 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-05e71b5e-4372-455c-9b79-7573c106183d tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:09.955628 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-05e71b5e-4372-455c-9b79-7573c106183d tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:09.962094 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05e71b5e-4372-455c-9b79-7573c106183d tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:09.962539 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05e71b5e-4372-455c-9b79-7573c106183d tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:09.963284 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05e71b5e-4372-455c-9b79-7573c106183d tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:09.964286 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05e71b5e-4372-455c-9b79-7573c106183d tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:10.240090 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-05e71b5e-4372-455c-9b79-7573c106183d tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:10.247901 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-05e71b5e-4372-455c-9b79-7573c106183d tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1555 microversion: 2.1 time: 0.297166 Jun 16 16:21:10.248458 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 477/954] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:09 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1555 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:11.264417 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-89029a5c-0324-4fab-b898-8639c9310af3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:11.265024 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-89029a5c-0324-4fab-b898-8639c9310af3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:11.271573 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-89029a5c-0324-4fab-b898-8639c9310af3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:11.272020 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-89029a5c-0324-4fab-b898-8639c9310af3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:11.272784 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-89029a5c-0324-4fab-b898-8639c9310af3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:11.273220 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-89029a5c-0324-4fab-b898-8639c9310af3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:11.401915 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-89029a5c-0324-4fab-b898-8639c9310af3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:11.409506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-89029a5c-0324-4fab-b898-8639c9310af3 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1555 microversion: 2.1 time: 0.148971 Jun 16 16:21:11.410107 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 478/955] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:11 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:12.427196 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-054072d0-8147-4c09-9a87-07eb667a703c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:12.427725 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-054072d0-8147-4c09-9a87-07eb667a703c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:12.434595 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-054072d0-8147-4c09-9a87-07eb667a703c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:12.435071 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-054072d0-8147-4c09-9a87-07eb667a703c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:12.435838 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-054072d0-8147-4c09-9a87-07eb667a703c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:12.436271 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-054072d0-8147-4c09-9a87-07eb667a703c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:12.646884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-8fb630b8-0ec6-48bb-88c3-92cb5c7ce63e req-5ea55502-ee9f-4f00-bddc-8868b75cdceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487bea5d-3ad7-4404-9b92-e6b60bc9cf2d", "name": "network-vif-deleted", "tag": "fad2c47a-ebb1-49bb-9bf9-18b302cdf9ab"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:12.657649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-8fb630b8-0ec6-48bb-88c3-92cb5c7ce63e req-5ea55502-ee9f-4f00-bddc-8868b75cdceb service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:12.658115 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-8fb630b8-0ec6-48bb-88c3-92cb5c7ce63e req-5ea55502-ee9f-4f00-bddc-8868b75cdceb service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:12.659311 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-054072d0-8147-4c09-9a87-07eb667a703c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e097835e6604a02a38b291786033f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731df982fd964de6bc4545103f7e1047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:12.666824 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-054072d0-8147-4c09-9a87-07eb667a703c tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 200 len: 1555 microversion: 2.1 time: 0.243634 Jun 16 16:21:12.667723 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 478/956] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:12 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 1555 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:12.680532 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-8fb630b8-0ec6-48bb-88c3-92cb5c7ce63e req-5ea55502-ee9f-4f00-bddc-8868b75cdceb service nova] Creating event network-vif-deleted:fad2c47a-ebb1-49bb-9bf9-18b302cdf9ab for instance 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d on hv-cinder-83735 Jun 16 16:21:12.685313 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-8fb630b8-0ec6-48bb-88c3-92cb5c7ce63e req-5ea55502-ee9f-4f00-bddc-8868b75cdceb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043540 Jun 16 16:21:12.685931 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 479/957] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:13.683692 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ddf3230a-d0ec-41c1-b168-3a04002b6d7f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:13.684302 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ddf3230a-d0ec-41c1-b168-3a04002b6d7f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] [instance: 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:13.690889 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ddf3230a-d0ec-41c1-b168-3a04002b6d7f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:13.691338 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ddf3230a-d0ec-41c1-b168-3a04002b6d7f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:13.692091 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ddf3230a-d0ec-41c1-b168-3a04002b6d7f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:13.692525 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ddf3230a-d0ec-41c1-b168-3a04002b6d7f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:13.706139 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-ddf3230a-d0ec-41c1-b168-3a04002b6d7f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] HTTP exception thrown: Instance 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d could not be found. Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ddf3230a-d0ec-41c1-b168-3a04002b6d7f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Request method failure captured: Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d HTTP/1.1 Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1cplhhlu6g4MT-GZ4IeFczAMkqPsiLX9LJKAbiOHnOXl6ZF0_IZIW-4Kvj0hh9kdiWHSpFvuTCLEBOlT5hV-tTqn4k8DqsM5OzEyLj42IyJq2zWkjulFY6bq9mb3fK4npvrvvSynht_0_NP7W6wCAwyyxqrM1tlMM9gjZlj9ZbvL4c Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: 731df982fd964de6bc4545103f7e1047 Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-TestMinimumBasicScenario-337610725 Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:21:13.707759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:21:13.709283 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/731df982fd964de6bc4545103f7e1047"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/731df982fd964de6bc4545103f7e1047"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_731df982fd964de6bc4545103f7e1047", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/731df982fd964de6bc4545103f7e1047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:21:13.709283 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-TestMinimumBasicScenario-337610725 Jun 16 16:21:13.709283 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 731df982fd964de6bc4545103f7e1047 Jun 16 16:21:13.709283 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-TestMinimumBasicScenario-337610725 Jun 16 16:21:13.709283 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-TestMinimumBasicScenario-337610725-project Jun 16 16:21:13.709283 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:21:13.709283 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:21:13.709283 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: 6e097835e6604a02a38b291786033f06 Jun 16 16:21:13.709283 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-TestMinimumBasicScenario-337610725-project Jun 16 16:21:13.709283 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:21:13.709283 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d could not be found. Jun 16 16:21:13.709283 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '487bea5d-3ad7-4404-9b92-e6b60bc9cf2d'} Jun 16 16:21:13.710164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:21:13.710164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:21:13.710164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:21:13.710164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:21:13.710164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:21:13.710164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:21:13.710164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:21:13.710164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:21:13.710164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:21:13.710164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:21:13.710164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d could not be found. Jun 16 16:21:13.710164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:21:13.710164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:21:13.710164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:21:13.710164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:21:13.710164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:21:13.710164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:21:13.710164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:21:13.710164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:21:13.710164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:21:13.711620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:21:13.711620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:21:13.711620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:21:13.711620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:21:13.711620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:21:13.711620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:21:13.711620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:21:13.711620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d could not be found. Jun 16 16:21:13.711620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:21:13.711620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:21:13.711620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:21:13.711620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:21:13.711620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:21:13.711620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:21:13.711620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:21:13.711620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:21:13.711620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d could not be found. Jun 16 16:21:13.711620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:21:13.713250 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ddf3230a-d0ec-41c1-b168-3a04002b6d7f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Returning 404 to user: Instance 487bea5d-3ad7-4404-9b92-e6b60bc9cf2d could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:21:13.713250 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ddf3230a-d0ec-41c1-b168-3a04002b6d7f tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d" status: 404 len: 111 microversion: 2.1 time: 0.029329 Jun 16 16:21:13.713250 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 479/958] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:13 2022] GET /compute/v2.1/servers/487bea5d-3ad7-4404-9b92-e6b60bc9cf2d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:21:13.719539 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-384a672f-86d9-4d3f-b875-9fa4afd57251 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] Calling method '.version_select at 0x7f6f0d28fca0>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:13.737252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-384a672f-86d9-4d3f-b875-9fa4afd57251 tempest-TestMinimumBasicScenario-337610725 tempest-TestMinimumBasicScenario-337610725-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-111651302" status: 202 len: 0 microversion: 2.1 time: 0.022470 Jun 16 16:21:13.738159 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 480/959] 10.222.0.88 () {58 vars in 1268 bytes} [Thu Jun 16 16:21:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-111651302 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:21:20.427012 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-040af4da-b5d5-40e6-b4f1-5115265e0570 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:20.428476 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-040af4da-b5d5-40e6-b4f1-5115265e0570 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:20.436162 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-040af4da-b5d5-40e6-b4f1-5115265e0570 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:20.436595 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-040af4da-b5d5-40e6-b4f1-5115265e0570 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:20.437361 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-040af4da-b5d5-40e6-b4f1-5115265e0570 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:20.437844 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-040af4da-b5d5-40e6-b4f1-5115265e0570 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:20.549223 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-040af4da-b5d5-40e6-b4f1-5115265e0570 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lazy-loading 'services' on Instance uuid 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:21:20.639520 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-040af4da-b5d5-40e6-b4f1-5115265e0570 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd/os-volume_attachments/ce3d5c1a-fafd-4eb2-9bad-6b2b875c2f4c" status: 202 len: 0 microversion: 2.1 time: 0.231248 Jun 16 16:21:20.640557 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 480/960] 10.222.0.88 () {58 vars in 1415 bytes} [Thu Jun 16 16:21:20 2022] DELETE /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd/os-volume_attachments/ce3d5c1a-fafd-4eb2-9bad-6b2b875c2f4c => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:21:20.649034 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-87f7f04d-d201-4538-8ddd-52c2bf31fdf8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:20.651373 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-87f7f04d-d201-4538-8ddd-52c2bf31fdf8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:20.671848 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-87f7f04d-d201-4538-8ddd-52c2bf31fdf8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:20.672421 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-87f7f04d-d201-4538-8ddd-52c2bf31fdf8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:20.673326 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-87f7f04d-d201-4538-8ddd-52c2bf31fdf8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:20.673875 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-87f7f04d-d201-4538-8ddd-52c2bf31fdf8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:20.723464 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-87f7f04d-d201-4538-8ddd-52c2bf31fdf8 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078552 Jun 16 16:21:20.724036 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 481/961] 10.222.0.88 () {58 vars in 1301 bytes} [Thu Jun 16 16:21:20 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:21.736462 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-87e42f05-7395-418c-b390-4ac48b1e9d6f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:21.737496 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-87e42f05-7395-418c-b390-4ac48b1e9d6f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:21.744743 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-87e42f05-7395-418c-b390-4ac48b1e9d6f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:21.745230 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-87e42f05-7395-418c-b390-4ac48b1e9d6f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:21.746042 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-87e42f05-7395-418c-b390-4ac48b1e9d6f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:21.746477 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-87e42f05-7395-418c-b390-4ac48b1e9d6f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:21.779145 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-87e42f05-7395-418c-b390-4ac48b1e9d6f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047163 Jun 16 16:21:21.779731 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 481/962] 10.222.0.88 () {58 vars in 1301 bytes} [Thu Jun 16 16:21:21 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:21:21.857995 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-dac911d5-c0cc-46af-ad5b-e40d1e3da895 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:21.858568 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dac911d5-c0cc-46af-ad5b-e40d1e3da895 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:21.864922 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dac911d5-c0cc-46af-ad5b-e40d1e3da895 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:21.865370 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dac911d5-c0cc-46af-ad5b-e40d1e3da895 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:21.866157 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dac911d5-c0cc-46af-ad5b-e40d1e3da895 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:21.866590 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dac911d5-c0cc-46af-ad5b-e40d1e3da895 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:21.891046 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dac911d5-c0cc-46af-ad5b-e40d1e3da895 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:21:21.965121 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-dac911d5-c0cc-46af-ad5b-e40d1e3da895 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 204 len: 0 microversion: 2.1 time: 0.110697 Jun 16 16:21:21.965821 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 482/963] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:21:21 2022] DELETE /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 16:21:21.974631 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ccf5d22e-e569-47bc-9fa9-e6cae6985a28 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:21.975234 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ccf5d22e-e569-47bc-9fa9-e6cae6985a28 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:21.981938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ccf5d22e-e569-47bc-9fa9-e6cae6985a28 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:21.982381 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ccf5d22e-e569-47bc-9fa9-e6cae6985a28 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:21.983126 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ccf5d22e-e569-47bc-9fa9-e6cae6985a28 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:21.983559 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ccf5d22e-e569-47bc-9fa9-e6cae6985a28 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:22.123674 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ccf5d22e-e569-47bc-9fa9-e6cae6985a28 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:22.131070 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ccf5d22e-e569-47bc-9fa9-e6cae6985a28 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1691 microversion: 2.1 time: 0.160804 Jun 16 16:21:22.131631 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 482/964] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:21 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:23.148773 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-207ccbfa-5f71-45bf-a0d3-ffccb8df695d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:23.149485 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-207ccbfa-5f71-45bf-a0d3-ffccb8df695d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:23.156738 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-207ccbfa-5f71-45bf-a0d3-ffccb8df695d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:23.157186 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-207ccbfa-5f71-45bf-a0d3-ffccb8df695d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:23.158002 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-207ccbfa-5f71-45bf-a0d3-ffccb8df695d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:23.158439 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-207ccbfa-5f71-45bf-a0d3-ffccb8df695d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:23.285382 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-207ccbfa-5f71-45bf-a0d3-ffccb8df695d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:23.293275 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-207ccbfa-5f71-45bf-a0d3-ffccb8df695d tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1691 microversion: 2.1 time: 0.148971 Jun 16 16:21:23.293865 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 483/965] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:23 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1691 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:24.311236 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8459f9c7-fab2-4f63-86ea-c83491e234f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:24.311874 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8459f9c7-fab2-4f63-86ea-c83491e234f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:24.318482 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8459f9c7-fab2-4f63-86ea-c83491e234f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:24.318925 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8459f9c7-fab2-4f63-86ea-c83491e234f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:24.319678 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8459f9c7-fab2-4f63-86ea-c83491e234f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:24.320103 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8459f9c7-fab2-4f63-86ea-c83491e234f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:24.448428 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8459f9c7-fab2-4f63-86ea-c83491e234f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:24.455467 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8459f9c7-fab2-4f63-86ea-c83491e234f1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1691 microversion: 2.1 time: 0.149066 Jun 16 16:21:24.456033 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 483/966] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:24 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1691 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:25.473332 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-aa45fdd1-4102-4c2a-bb41-7b1ce8534a41 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:25.473883 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-aa45fdd1-4102-4c2a-bb41-7b1ce8534a41 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:25.480387 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa45fdd1-4102-4c2a-bb41-7b1ce8534a41 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:25.480839 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa45fdd1-4102-4c2a-bb41-7b1ce8534a41 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:25.481606 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa45fdd1-4102-4c2a-bb41-7b1ce8534a41 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:25.482066 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-aa45fdd1-4102-4c2a-bb41-7b1ce8534a41 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:25.610609 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-aa45fdd1-4102-4c2a-bb41-7b1ce8534a41 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:25.618043 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-aa45fdd1-4102-4c2a-bb41-7b1ce8534a41 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1691 microversion: 2.1 time: 0.148957 Jun 16 16:21:25.618612 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 484/967] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:25 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1691 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:26.635027 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5e03e945-f23f-4c33-8ace-9d9df0d36341 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:26.635642 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5e03e945-f23f-4c33-8ace-9d9df0d36341 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:26.643441 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5e03e945-f23f-4c33-8ace-9d9df0d36341 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:26.643919 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5e03e945-f23f-4c33-8ace-9d9df0d36341 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:26.644819 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5e03e945-f23f-4c33-8ace-9d9df0d36341 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:26.645275 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5e03e945-f23f-4c33-8ace-9d9df0d36341 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:26.784177 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5e03e945-f23f-4c33-8ace-9d9df0d36341 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:26.793551 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5e03e945-f23f-4c33-8ace-9d9df0d36341 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 200 len: 1623 microversion: 2.1 time: 0.162417 Jun 16 16:21:26.794369 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 484/968] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:26 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 1623 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:26.900893 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-646a53aa-a540-46d0-8a34-cc75dc34eea2 req-ccbd7ecf-ddf1-4e34-97e3-a9536d76d23f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bac54eb-7ea8-4c97-a1f1-7c1da22baccd", "name": "network-vif-deleted", "tag": "620a39ba-f7e2-4ae1-acf0-e87136dc559c"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:26.909677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-646a53aa-a540-46d0-8a34-cc75dc34eea2 req-ccbd7ecf-ddf1-4e34-97e3-a9536d76d23f service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:26.910515 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-646a53aa-a540-46d0-8a34-cc75dc34eea2 req-ccbd7ecf-ddf1-4e34-97e3-a9536d76d23f service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:26.924040 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-646a53aa-a540-46d0-8a34-cc75dc34eea2 req-ccbd7ecf-ddf1-4e34-97e3-a9536d76d23f service nova] Creating event network-vif-deleted:620a39ba-f7e2-4ae1-acf0-e87136dc559c for instance 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd on hv-cinder-83735 Jun 16 16:21:26.929252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-646a53aa-a540-46d0-8a34-cc75dc34eea2 req-ccbd7ecf-ddf1-4e34-97e3-a9536d76d23f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032131 Jun 16 16:21:26.930201 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 485/969] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:27.812215 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0c937874-d4c7-41c6-afec-2151836f5e5b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:27.812824 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0c937874-d4c7-41c6-afec-2151836f5e5b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:27.819406 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0c937874-d4c7-41c6-afec-2151836f5e5b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:27.819811 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0c937874-d4c7-41c6-afec-2151836f5e5b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:27.820579 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0c937874-d4c7-41c6-afec-2151836f5e5b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:27.821015 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0c937874-d4c7-41c6-afec-2151836f5e5b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:27.834479 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-0c937874-d4c7-41c6-afec-2151836f5e5b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] HTTP exception thrown: Instance 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd could not be found. Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0c937874-d4c7-41c6-afec-2151836f5e5b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Request method failure captured: Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd HTTP/1.1 Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1Z54hJE2l_KKrM9e-Q92EFzRQefo-JKdfbLMPwz8oT-C787IrLRWMX8P4Lf_5ySi9IC_PuB8AW1WtFXSETwf3dcsXRZWC9FFHHN_a0Os7DqGZog0zeiyFPM_4eOL5z3sIiGBxl1xGfVrAMC6ZsPAzRZXMxNahInJw9LdOx_iPcmPBQ Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: c3592ee016d1486db983b4ff2aab5ca3 Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1916877350 Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:21:27.836179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:21:27.837936 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c3592ee016d1486db983b4ff2aab5ca3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c3592ee016d1486db983b4ff2aab5ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c3592ee016d1486db983b4ff2aab5ca3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c3592ee016d1486db983b4ff2aab5ca3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:21:27.837936 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1916877350 Jun 16 16:21:27.837936 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: c3592ee016d1486db983b4ff2aab5ca3 Jun 16 16:21:27.837936 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1916877350 Jun 16 16:21:27.837936 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-ServerRescueNegativeTestJSON-1916877350-project Jun 16 16:21:27.837936 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:21:27.837936 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:21:27.837936 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: 16b8389777744e6581ad14be85731f4a Jun 16 16:21:27.837936 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1916877350-project Jun 16 16:21:27.837936 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:21:27.837936 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd could not be found. Jun 16 16:21:27.837936 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '3bac54eb-7ea8-4c97-a1f1-7c1da22baccd'} Jun 16 16:21:27.838739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:21:27.838739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:21:27.838739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:21:27.838739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:21:27.838739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:21:27.838739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:21:27.838739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:21:27.838739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:21:27.838739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:21:27.838739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:21:27.838739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd could not be found. Jun 16 16:21:27.838739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:21:27.838739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:21:27.838739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:21:27.838739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:21:27.838739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:21:27.838739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:21:27.838739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:21:27.838739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:21:27.838739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:21:27.840066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:21:27.840066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:21:27.840066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:21:27.840066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:21:27.840066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:21:27.840066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:21:27.840066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:21:27.840066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd could not be found. Jun 16 16:21:27.840066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:21:27.840066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:21:27.840066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:21:27.840066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:21:27.840066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:21:27.840066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:21:27.840066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:21:27.840066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:21:27.840066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd could not be found. Jun 16 16:21:27.840066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:21:27.841316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0c937874-d4c7-41c6-afec-2151836f5e5b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Returning 404 to user: Instance 3bac54eb-7ea8-4c97-a1f1-7c1da22baccd could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:21:27.841316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0c937874-d4c7-41c6-afec-2151836f5e5b tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd" status: 404 len: 111 microversion: 2.1 time: 0.029298 Jun 16 16:21:27.841316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 485/970] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:27 2022] GET /compute/v2.1/servers/3bac54eb-7ea8-4c97-a1f1-7c1da22baccd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:21:27.847775 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-560ef6c3-0cfe-4398-b17e-1d16f51d45b5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '.version_select at 0x7f6f0d19d940>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:27.865856 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-560ef6c3-0cfe-4398-b17e-1d16f51d45b5 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-748128690" status: 202 len: 0 microversion: 2.1 time: 0.022733 Jun 16 16:21:27.866520 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 486/971] 10.222.0.88 () {58 vars in 1217 bytes} [Thu Jun 16 16:21:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-748128690 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:21:30.723970 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e72e02ef-a37d-4051-b9f3-e4c3e6894d91 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:30.724487 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e72e02ef-a37d-4051-b9f3-e4c3e6894d91 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:30.731805 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e72e02ef-a37d-4051-b9f3-e4c3e6894d91 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:30.732256 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e72e02ef-a37d-4051-b9f3-e4c3e6894d91 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:30.733022 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e72e02ef-a37d-4051-b9f3-e4c3e6894d91 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:30.733457 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e72e02ef-a37d-4051-b9f3-e4c3e6894d91 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:30.758409 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e72e02ef-a37d-4051-b9f3-e4c3e6894d91 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:21:30.791391 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:30.834601 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e72e02ef-a37d-4051-b9f3-e4c3e6894d91 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 204 len: 0 microversion: 2.1 time: 0.114396 Jun 16 16:21:30.835244 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 486/972] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:21:30 2022] DELETE /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:21:30.844752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0351e161-6327-4d86-982f-9a8a9c1466e1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:30.845491 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0351e161-6327-4d86-982f-9a8a9c1466e1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:30.852088 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0351e161-6327-4d86-982f-9a8a9c1466e1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:30.852540 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0351e161-6327-4d86-982f-9a8a9c1466e1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:30.853340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0351e161-6327-4d86-982f-9a8a9c1466e1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:30.854328 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0351e161-6327-4d86-982f-9a8a9c1466e1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:30.985572 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0351e161-6327-4d86-982f-9a8a9c1466e1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:30.993033 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0351e161-6327-4d86-982f-9a8a9c1466e1 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1508 microversion: 2.1 time: 0.153627 Jun 16 16:21:30.993597 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 487/973] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:30 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:32.011498 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e69960d3-a50f-47af-8f2c-ed968f2eed78 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:32.012271 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e69960d3-a50f-47af-8f2c-ed968f2eed78 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:32.018470 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e69960d3-a50f-47af-8f2c-ed968f2eed78 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:32.018915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e69960d3-a50f-47af-8f2c-ed968f2eed78 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:32.019665 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e69960d3-a50f-47af-8f2c-ed968f2eed78 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:32.020102 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e69960d3-a50f-47af-8f2c-ed968f2eed78 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:32.205550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e69960d3-a50f-47af-8f2c-ed968f2eed78 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:32.213952 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e69960d3-a50f-47af-8f2c-ed968f2eed78 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 200 len: 1508 microversion: 2.1 time: 0.207139 Jun 16 16:21:32.214919 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 487/974] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:32 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 1508 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:32.295971 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-e81d16a7-c5e2-407c-9fb8-67204d01d0e4 req-987a458f-0c40-430e-a421-5ced612072ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1", "name": "network-vif-deleted", "tag": "52a71ee6-44fd-4a71-b587-86f364e02e17"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:32.305774 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-e81d16a7-c5e2-407c-9fb8-67204d01d0e4 req-987a458f-0c40-430e-a421-5ced612072ed service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:32.306218 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-e81d16a7-c5e2-407c-9fb8-67204d01d0e4 req-987a458f-0c40-430e-a421-5ced612072ed service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:32.317943 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-e81d16a7-c5e2-407c-9fb8-67204d01d0e4 req-987a458f-0c40-430e-a421-5ced612072ed service nova] Creating event network-vif-deleted:52a71ee6-44fd-4a71-b587-86f364e02e17 for instance 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 on hv-cinder-83735 Jun 16 16:21:32.323404 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-e81d16a7-c5e2-407c-9fb8-67204d01d0e4 req-987a458f-0c40-430e-a421-5ced612072ed service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031212 Jun 16 16:21:32.324121 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 488/975] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:33.231240 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d4013aba-5395-4c92-b207-0fa0305da239 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:33.231848 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d4013aba-5395-4c92-b207-0fa0305da239 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:33.234228 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:33.239533 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d4013aba-5395-4c92-b207-0fa0305da239 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:33.239990 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d4013aba-5395-4c92-b207-0fa0305da239 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:33.240740 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d4013aba-5395-4c92-b207-0fa0305da239 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:33.241176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d4013aba-5395-4c92-b207-0fa0305da239 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:33.255260 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-d4013aba-5395-4c92-b207-0fa0305da239 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] HTTP exception thrown: Instance 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 could not be found. Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d4013aba-5395-4c92-b207-0fa0305da239 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Request method failure captured: Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 HTTP/1.1 Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1Z54hJE2l_KKrM9e-Q92EFzRQefo-JKdfbLMPwz8oT-C787IrLRWMX8P4Lf_5ySi9IC_PuB8AW1WtFXSETwf3dcsXRZWC9FFHHN_a0Os7DqGZog0zeiyFPM_4eOL5z3sIiGBxl1xGfVrAMC6ZsPAzRZXMxNahInJw9LdOx_iPcmPBQ Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: c3592ee016d1486db983b4ff2aab5ca3 Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1916877350 Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:21:33.256934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:21:33.258506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c3592ee016d1486db983b4ff2aab5ca3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c3592ee016d1486db983b4ff2aab5ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c3592ee016d1486db983b4ff2aab5ca3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c3592ee016d1486db983b4ff2aab5ca3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:21:33.258506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1916877350 Jun 16 16:21:33.258506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: c3592ee016d1486db983b4ff2aab5ca3 Jun 16 16:21:33.258506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1916877350 Jun 16 16:21:33.258506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-ServerRescueNegativeTestJSON-1916877350-project Jun 16 16:21:33.258506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:21:33.258506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:21:33.258506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: 16b8389777744e6581ad14be85731f4a Jun 16 16:21:33.258506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1916877350-project Jun 16 16:21:33.258506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:21:33.258506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 could not be found. Jun 16 16:21:33.258506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1'} Jun 16 16:21:33.260649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:21:33.260649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:21:33.260649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:21:33.260649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:21:33.260649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:21:33.260649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:21:33.260649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:21:33.260649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:21:33.260649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:21:33.260649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:21:33.260649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 could not be found. Jun 16 16:21:33.260649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:21:33.260649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:21:33.260649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:21:33.260649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:21:33.260649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:21:33.260649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:21:33.260649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:21:33.260649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:21:33.260649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:21:33.262072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:21:33.262072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:21:33.262072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:21:33.262072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:21:33.262072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:21:33.262072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:21:33.262072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:21:33.262072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 could not be found. Jun 16 16:21:33.262072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:21:33.262072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:21:33.262072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:21:33.262072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:21:33.262072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:21:33.262072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:21:33.262072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:21:33.262072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:21:33.262072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 could not be found. Jun 16 16:21:33.262072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:21:33.263197 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d4013aba-5395-4c92-b207-0fa0305da239 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Returning 404 to user: Instance 3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:21:33.263197 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d4013aba-5395-4c92-b207-0fa0305da239 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1" status: 404 len: 111 microversion: 2.1 time: 0.031053 Jun 16 16:21:33.263197 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 488/976] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:33 2022] GET /compute/v2.1/servers/3ec3e781-8a30-4b8d-abc4-ebbd233ee3b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:21:33.267870 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-07e6b447-38be-4fa4-ba04-2bab1678cb59 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:33.268450 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-07e6b447-38be-4fa4-ba04-2bab1678cb59 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:33.274680 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-07e6b447-38be-4fa4-ba04-2bab1678cb59 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:33.275127 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-07e6b447-38be-4fa4-ba04-2bab1678cb59 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:33.275912 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-07e6b447-38be-4fa4-ba04-2bab1678cb59 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:33.276346 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-07e6b447-38be-4fa4-ba04-2bab1678cb59 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:33.300312 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-07e6b447-38be-4fa4-ba04-2bab1678cb59 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:21:33.372299 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-07e6b447-38be-4fa4-ba04-2bab1678cb59 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "DELETE /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 204 len: 0 microversion: 2.1 time: 0.108327 Jun 16 16:21:33.372838 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 489/977] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:21:33 2022] DELETE /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:21:33.381133 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-88d58e0f-7b37-4b2d-81d6-87aed18819dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:33.381782 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-88d58e0f-7b37-4b2d-81d6-87aed18819dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:33.388327 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-88d58e0f-7b37-4b2d-81d6-87aed18819dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:33.388781 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-88d58e0f-7b37-4b2d-81d6-87aed18819dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:33.389538 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-88d58e0f-7b37-4b2d-81d6-87aed18819dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:33.390029 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-88d58e0f-7b37-4b2d-81d6-87aed18819dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:33.523552 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-88d58e0f-7b37-4b2d-81d6-87aed18819dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:33.530987 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-88d58e0f-7b37-4b2d-81d6-87aed18819dc tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.154132 Jun 16 16:21:33.531542 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 489/978] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:33 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:34.548560 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-56c562a6-c83f-4824-adca-9162095db76f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:34.549258 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-56c562a6-c83f-4824-adca-9162095db76f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:34.556098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-56c562a6-c83f-4824-adca-9162095db76f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:34.556603 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-56c562a6-c83f-4824-adca-9162095db76f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:34.557384 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-56c562a6-c83f-4824-adca-9162095db76f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:34.557862 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-56c562a6-c83f-4824-adca-9162095db76f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:34.561983 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:34.754732 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-56c562a6-c83f-4824-adca-9162095db76f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16b8389777744e6581ad14be85731f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3592ee016d1486db983b4ff2aab5ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:34.762535 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-56c562a6-c83f-4824-adca-9162095db76f tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 200 len: 1523 microversion: 2.1 time: 0.218196 Jun 16 16:21:34.764774 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 490/979] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:34 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:21:34.861760 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-08ed0b67-24a4-4f86-8b69-4034e9f6ad21 req-4d2382c3-4660-42ad-bb0f-11102f5b0c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c1389bc-ae98-44d1-943a-669b44dde9ad", "name": "network-vif-deleted", "tag": "9fc73dbb-a75c-415a-b8f8-fbf849262a05"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:34.871732 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-08ed0b67-24a4-4f86-8b69-4034e9f6ad21 req-4d2382c3-4660-42ad-bb0f-11102f5b0c70 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:34.872201 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-08ed0b67-24a4-4f86-8b69-4034e9f6ad21 req-4d2382c3-4660-42ad-bb0f-11102f5b0c70 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:34.883982 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-08ed0b67-24a4-4f86-8b69-4034e9f6ad21 req-4d2382c3-4660-42ad-bb0f-11102f5b0c70 service nova] Creating event network-vif-deleted:9fc73dbb-a75c-415a-b8f8-fbf849262a05 for instance 7c1389bc-ae98-44d1-943a-669b44dde9ad on hv-cinder-83735 Jun 16 16:21:34.888888 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-08ed0b67-24a4-4f86-8b69-4034e9f6ad21 req-4d2382c3-4660-42ad-bb0f-11102f5b0c70 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030843 Jun 16 16:21:34.889948 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 490/980] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:35.779811 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ff443b27-40e2-4f27-9360-17171e9329c7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:35.780422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ff443b27-40e2-4f27-9360-17171e9329c7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] [instance: 7c1389bc-ae98-44d1-943a-669b44dde9ad] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:35.782864 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:35.788136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ff443b27-40e2-4f27-9360-17171e9329c7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:35.788627 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ff443b27-40e2-4f27-9360-17171e9329c7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:35.789362 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ff443b27-40e2-4f27-9360-17171e9329c7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:35.789830 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ff443b27-40e2-4f27-9360-17171e9329c7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:35.804797 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-ff443b27-40e2-4f27-9360-17171e9329c7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] HTTP exception thrown: Instance 7c1389bc-ae98-44d1-943a-669b44dde9ad could not be found. Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ff443b27-40e2-4f27-9360-17171e9329c7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Request method failure captured: Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad HTTP/1.1 Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1Z54hJE2l_KKrM9e-Q92EFzRQefo-JKdfbLMPwz8oT-C787IrLRWMX8P4Lf_5ySi9IC_PuB8AW1WtFXSETwf3dcsXRZWC9FFHHN_a0Os7DqGZog0zeiyFPM_4eOL5z3sIiGBxl1xGfVrAMC6ZsPAzRZXMxNahInJw9LdOx_iPcmPBQ Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: c3592ee016d1486db983b4ff2aab5ca3 Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1916877350 Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:21:35.806974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:21:35.808545 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c3592ee016d1486db983b4ff2aab5ca3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c3592ee016d1486db983b4ff2aab5ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c3592ee016d1486db983b4ff2aab5ca3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c3592ee016d1486db983b4ff2aab5ca3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:21:35.808545 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1916877350 Jun 16 16:21:35.808545 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: c3592ee016d1486db983b4ff2aab5ca3 Jun 16 16:21:35.808545 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1916877350 Jun 16 16:21:35.808545 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-ServerRescueNegativeTestJSON-1916877350-project Jun 16 16:21:35.808545 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:21:35.808545 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:21:35.808545 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: 16b8389777744e6581ad14be85731f4a Jun 16 16:21:35.808545 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1916877350-project Jun 16 16:21:35.808545 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:21:35.808545 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Instance 7c1389bc-ae98-44d1-943a-669b44dde9ad could not be found. Jun 16 16:21:35.808545 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': '7c1389bc-ae98-44d1-943a-669b44dde9ad'} Jun 16 16:21:35.809551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:21:35.809551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:21:35.809551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:21:35.809551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:21:35.809551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:21:35.809551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:21:35.809551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:21:35.809551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:21:35.809551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:21:35.809551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:21:35.809551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c1389bc-ae98-44d1-943a-669b44dde9ad could not be found. Jun 16 16:21:35.809551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:21:35.809551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:21:35.809551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:21:35.809551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:21:35.809551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:21:35.809551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:21:35.809551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:21:35.809551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:21:35.809551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:21:35.810960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:21:35.810960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:21:35.810960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:21:35.810960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:21:35.810960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:21:35.810960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:21:35.810960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:21:35.810960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c1389bc-ae98-44d1-943a-669b44dde9ad could not be found. Jun 16 16:21:35.810960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:21:35.810960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:21:35.810960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:21:35.810960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:21:35.810960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:21:35.810960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:21:35.810960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:21:35.810960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:21:35.810960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c1389bc-ae98-44d1-943a-669b44dde9ad could not be found. Jun 16 16:21:35.810960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:21:35.812361 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ff443b27-40e2-4f27-9360-17171e9329c7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] Returning 404 to user: Instance 7c1389bc-ae98-44d1-943a-669b44dde9ad could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:21:35.812361 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ff443b27-40e2-4f27-9360-17171e9329c7 tempest-ServerRescueNegativeTestJSON-1916877350 tempest-ServerRescueNegativeTestJSON-1916877350-project] 10.222.0.88 "GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad" status: 404 len: 111 microversion: 2.1 time: 0.032538 Jun 16 16:21:35.812361 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 491/981] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:35 2022] GET /compute/v2.1/servers/7c1389bc-ae98-44d1-943a-669b44dde9ad => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:21:44.400450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-619dc781-1178-4538-b51c-3482f7db59a4 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Action: 'create', calling method: .version_select at 0x7f6f118cd8b0>, body: {"keypair": {"name": "tempest-keypair-171472634", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuvFZ5LFUdeDaVJOmmSV6GTNVqYo/xtfzZgxjHoTcjexTWF3Dzo/UWw7IuYXqqgibP5Tjr6Q7qWTXWdF1o9vQ/phV7ZhZ9Is0Vg0TPSfB7KfgLZTD/5VBT1Xqm/a6GnGQ=="}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:44.414967 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-619dc781-1178-4538-b51c-3482f7db59a4 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Getting quotas for project 41f6c4a1b7784d7d874b00d5e43507cf. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:21:44.419303 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-619dc781-1178-4538-b51c-3482f7db59a4 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Getting quotas for user c6c53bf1554a4825afd8770ea9347ad1 and project 41f6c4a1b7784d7d874b00d5e43507cf. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:21:44.441530 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-619dc781-1178-4538-b51c-3482f7db59a4 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.158431 Jun 16 16:21:44.442178 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 491/982] 10.222.0.88 () {60 vars in 1158 bytes} [Thu Jun 16 16:21:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:45.797252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-80990757-38d4-4d10-b05a-1cf0a3ccbd9e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1282810110", "imageRef": "d2716dc1-3d4d-4f62-b0af-c38986f2a3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45ef15c7-612b-46f3-8f14-2e68fe914c36"}], "security_groups": [{"name": "tempest-securitygroup--1916757966"}], "key_name": "tempest-keypair-171472634", "user_data": "}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:45.804589 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=7 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:45.900624 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-80990757-38d4-4d10-b05a-1cf0a3ccbd9e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] validate_networks() for [('45ef15c7-612b-46f3-8f14-2e68fe914c36', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:21:46.516541 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-80990757-38d4-4d10-b05a-1cf0a3ccbd9e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:21:46.517234 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-80990757-38d4-4d10-b05a-1cf0a3ccbd9e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:21:46.517772 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-80990757-38d4-4d10-b05a-1cf0a3ccbd9e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:21:46.518215 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-80990757-38d4-4d10-b05a-1cf0a3ccbd9e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:21:46.518630 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-80990757-38d4-4d10-b05a-1cf0a3ccbd9e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:21:46.528756 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-80990757-38d4-4d10-b05a-1cf0a3ccbd9e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:46.529356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-80990757-38d4-4d10-b05a-1cf0a3ccbd9e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:46.530204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-80990757-38d4-4d10-b05a-1cf0a3ccbd9e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:46.530649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-80990757-38d4-4d10-b05a-1cf0a3ccbd9e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:46.548466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-80990757-38d4-4d10-b05a-1cf0a3ccbd9e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Getting quotas for project 41f6c4a1b7784d7d874b00d5e43507cf. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:21:46.552460 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-80990757-38d4-4d10-b05a-1cf0a3ccbd9e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Getting quotas for user c6c53bf1554a4825afd8770ea9347ad1 and project 41f6c4a1b7784d7d874b00d5e43507cf. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:21:46.564849 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-80990757-38d4-4d10-b05a-1cf0a3ccbd9e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:21:46.567182 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-80990757-38d4-4d10-b05a-1cf0a3ccbd9e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2716dc1-3d4d-4f62-b0af-c38986f2a3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:21:46.618396 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-80990757-38d4-4d10-b05a-1cf0a3ccbd9e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.825781 Jun 16 16:21:46.624018 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 492/983] 10.222.0.88 () {60 vars in 1146 bytes} [Thu Jun 16 16:21:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 16:21:46.629001 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5f1885a7-4eea-4424-ba22-c093d9aa478b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:46.629874 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5f1885a7-4eea-4424-ba22-c093d9aa478b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:46.632550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:46.692377 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5f1885a7-4eea-4424-ba22-c093d9aa478b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:46.702000 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5f1885a7-4eea-4424-ba22-c093d9aa478b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1237 microversion: 2.1 time: 0.076838 Jun 16 16:21:46.710656 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 492/984] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:46 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1237 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:47.726489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fad431b6-424f-4041-a101-742c08558926 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:47.728577 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fad431b6-424f-4041-a101-742c08558926 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:47.738217 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fad431b6-424f-4041-a101-742c08558926 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:47.738583 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fad431b6-424f-4041-a101-742c08558926 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:47.739420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fad431b6-424f-4041-a101-742c08558926 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:47.739859 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fad431b6-424f-4041-a101-742c08558926 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:47.856375 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-fad431b6-424f-4041-a101-742c08558926 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:47.880175 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fad431b6-424f-4041-a101-742c08558926 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1297 microversion: 2.1 time: 0.160732 Jun 16 16:21:47.881763 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 493/985] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:47 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1297 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:48.902093 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-64884c0b-5374-4878-9922-6c37d6933940 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:48.903053 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-64884c0b-5374-4878-9922-6c37d6933940 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:48.912883 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-64884c0b-5374-4878-9922-6c37d6933940 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:48.913638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-64884c0b-5374-4878-9922-6c37d6933940 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:48.914492 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-64884c0b-5374-4878-9922-6c37d6933940 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:48.915110 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-64884c0b-5374-4878-9922-6c37d6933940 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:49.107608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-64884c0b-5374-4878-9922-6c37d6933940 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:49.115912 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-64884c0b-5374-4878-9922-6c37d6933940 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1363 microversion: 2.1 time: 0.220635 Jun 16 16:21:49.126014 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 493/986] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:48 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:49.396853 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-faeb1c8b-44a3-437b-80b4-886dd8b91efb req-923441ef-8d6b-403b-8f3b-a0ce0a9a6b89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0f7646-c731-405a-ac41-0e889b5fdb56", "tag": "fb44d1d7-b555-4a7c-9246-8f035d594d28"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:49.417010 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-faeb1c8b-44a3-437b-80b4-886dd8b91efb req-923441ef-8d6b-403b-8f3b-a0ce0a9a6b89 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:49.417951 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-faeb1c8b-44a3-437b-80b4-886dd8b91efb req-923441ef-8d6b-403b-8f3b-a0ce0a9a6b89 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:49.431811 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-faeb1c8b-44a3-437b-80b4-886dd8b91efb req-923441ef-8d6b-403b-8f3b-a0ce0a9a6b89 service nova] Creating event network-changed:fb44d1d7-b555-4a7c-9246-8f035d594d28 for instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 on hv-cinder-83735 Jun 16 16:21:49.437766 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-faeb1c8b-44a3-437b-80b4-886dd8b91efb req-923441ef-8d6b-403b-8f3b-a0ce0a9a6b89 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053575 Jun 16 16:21:49.438642 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 494/987] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:50.133780 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3010edcb-7d4f-4345-ac91-57c6dc5f816c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:50.134854 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3010edcb-7d4f-4345-ac91-57c6dc5f816c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:50.141846 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3010edcb-7d4f-4345-ac91-57c6dc5f816c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:50.142298 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3010edcb-7d4f-4345-ac91-57c6dc5f816c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:50.143057 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3010edcb-7d4f-4345-ac91-57c6dc5f816c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:50.143490 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3010edcb-7d4f-4345-ac91-57c6dc5f816c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:50.270769 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3010edcb-7d4f-4345-ac91-57c6dc5f816c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:50.278780 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3010edcb-7d4f-4345-ac91-57c6dc5f816c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1363 microversion: 2.1 time: 0.149002 Jun 16 16:21:50.279341 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 494/988] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:50 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:51.295632 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f765f84c-ddc9-4f70-a5ce-bc69e5b51e20 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:51.296328 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f765f84c-ddc9-4f70-a5ce-bc69e5b51e20 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:51.303006 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f765f84c-ddc9-4f70-a5ce-bc69e5b51e20 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:51.303499 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f765f84c-ddc9-4f70-a5ce-bc69e5b51e20 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:51.304252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f765f84c-ddc9-4f70-a5ce-bc69e5b51e20 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:51.304683 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f765f84c-ddc9-4f70-a5ce-bc69e5b51e20 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:51.440679 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f765f84c-ddc9-4f70-a5ce-bc69e5b51e20 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:51.448654 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f765f84c-ddc9-4f70-a5ce-bc69e5b51e20 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1363 microversion: 2.1 time: 0.157250 Jun 16 16:21:51.449207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 495/989] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:51 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:21:52.465689 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-17ff2604-0df6-4469-97b8-9b7298ac3daf tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:52.466243 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-17ff2604-0df6-4469-97b8-9b7298ac3daf tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:52.472943 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-17ff2604-0df6-4469-97b8-9b7298ac3daf tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:52.473397 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-17ff2604-0df6-4469-97b8-9b7298ac3daf tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:52.474213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-17ff2604-0df6-4469-97b8-9b7298ac3daf tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:52.474649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-17ff2604-0df6-4469-97b8-9b7298ac3daf tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:52.672931 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-17ff2604-0df6-4469-97b8-9b7298ac3daf tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:52.680379 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-17ff2604-0df6-4469-97b8-9b7298ac3daf tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1363 microversion: 2.1 time: 0.219315 Jun 16 16:21:52.682120 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 495/990] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:52 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:53.256683 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8462ff84-b28c-43c5-acd1-ffdd4cc4fbd3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:53.262351 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-e212ab12-c7bc-4445-9627-8c4e6514ad7a req-f2c17ae8-c6df-4684-b04f-0d4678a711e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c92e5c48-0ac8-4a24-9e6b-019b7825b0b4", "tag": "fd0e55d6-c023-4540-8b9f-28e600c52b4f"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:53.266448 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8462ff84-b28c-43c5-acd1-ffdd4cc4fbd3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:53.278431 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-e212ab12-c7bc-4445-9627-8c4e6514ad7a req-f2c17ae8-c6df-4684-b04f-0d4678a711e6 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:53.278883 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-e212ab12-c7bc-4445-9627-8c4e6514ad7a req-f2c17ae8-c6df-4684-b04f-0d4678a711e6 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:53.279646 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8462ff84-b28c-43c5-acd1-ffdd4cc4fbd3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:53.280108 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8462ff84-b28c-43c5-acd1-ffdd4cc4fbd3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:53.280893 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8462ff84-b28c-43c5-acd1-ffdd4cc4fbd3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:53.281334 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8462ff84-b28c-43c5-acd1-ffdd4cc4fbd3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:53.290654 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-e212ab12-c7bc-4445-9627-8c4e6514ad7a req-f2c17ae8-c6df-4684-b04f-0d4678a711e6 service nova] Creating event network-changed:fd0e55d6-c023-4540-8b9f-28e600c52b4f for instance c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 on hv-cinder-83735 Jun 16 16:21:53.296111 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-e212ab12-c7bc-4445-9627-8c4e6514ad7a req-f2c17ae8-c6df-4684-b04f-0d4678a711e6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037693 Jun 16 16:21:53.297061 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 496/991] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:53.310307 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8462ff84-b28c-43c5-acd1-ffdd4cc4fbd3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:21:53.392244 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8462ff84-b28c-43c5-acd1-ffdd4cc4fbd3 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 204 len: 0 microversion: 2.1 time: 0.139130 Jun 16 16:21:53.393072 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 496/992] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:21:53 2022] DELETE /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 16:21:53.403759 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-350060ac-3bdc-4d18-b66f-4864b1850295 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:53.404475 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-350060ac-3bdc-4d18-b66f-4864b1850295 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:53.411215 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-350060ac-3bdc-4d18-b66f-4864b1850295 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:53.412814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-350060ac-3bdc-4d18-b66f-4864b1850295 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:53.412949 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-350060ac-3bdc-4d18-b66f-4864b1850295 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:53.413378 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-350060ac-3bdc-4d18-b66f-4864b1850295 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:53.580579 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-350060ac-3bdc-4d18-b66f-4864b1850295 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:53.588899 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-350060ac-3bdc-4d18-b66f-4864b1850295 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1566 microversion: 2.1 time: 0.191153 Jun 16 16:21:53.589466 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 497/993] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:53 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1566 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:53.698401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b4d82c29-141c-4e13-9da8-9d10d649b1d2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:53.699122 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b4d82c29-141c-4e13-9da8-9d10d649b1d2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:53.705005 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b4d82c29-141c-4e13-9da8-9d10d649b1d2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:53.705451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b4d82c29-141c-4e13-9da8-9d10d649b1d2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:53.706245 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b4d82c29-141c-4e13-9da8-9d10d649b1d2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:53.706792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b4d82c29-141c-4e13-9da8-9d10d649b1d2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:53.843095 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b4d82c29-141c-4e13-9da8-9d10d649b1d2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:53.850989 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b4d82c29-141c-4e13-9da8-9d10d649b1d2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1363 microversion: 2.1 time: 0.156818 Jun 16 16:21:53.851580 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 497/994] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:53 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:54.607269 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cc026930-4e17-43da-aecb-e832efc18c35 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:54.608405 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-cc026930-4e17-43da-aecb-e832efc18c35 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:54.614560 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc026930-4e17-43da-aecb-e832efc18c35 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:54.614995 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc026930-4e17-43da-aecb-e832efc18c35 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:54.615740 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc026930-4e17-43da-aecb-e832efc18c35 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:54.616165 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc026930-4e17-43da-aecb-e832efc18c35 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:54.824425 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cc026930-4e17-43da-aecb-e832efc18c35 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:54.832309 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cc026930-4e17-43da-aecb-e832efc18c35 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1566 microversion: 2.1 time: 0.229550 Jun 16 16:21:54.832906 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 498/995] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:54 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1566 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:54.868370 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ec91d27d-cd33-4338-991c-264a1000af83 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:54.868881 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ec91d27d-cd33-4338-991c-264a1000af83 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:54.875252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ec91d27d-cd33-4338-991c-264a1000af83 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:54.875698 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ec91d27d-cd33-4338-991c-264a1000af83 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:54.876455 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ec91d27d-cd33-4338-991c-264a1000af83 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:54.876895 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ec91d27d-cd33-4338-991c-264a1000af83 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:55.004967 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ec91d27d-cd33-4338-991c-264a1000af83 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:55.012945 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ec91d27d-cd33-4338-991c-264a1000af83 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1363 microversion: 2.1 time: 0.148502 Jun 16 16:21:55.013511 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 498/996] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:54 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:55.786720 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-0175f222-5da3-4fe1-95ff-b5c549d4bd13 req-e3736eb3-7f78-45df-a90a-56e1f072b85c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0f7646-c731-405a-ac41-0e889b5fdb56", "name": "network-vif-plugged", "status": "completed", "tag": "fb44d1d7-b555-4a7c-9246-8f035d594d28"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:55.798006 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-0175f222-5da3-4fe1-95ff-b5c549d4bd13 req-e3736eb3-7f78-45df-a90a-56e1f072b85c service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:55.798574 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-0175f222-5da3-4fe1-95ff-b5c549d4bd13 req-e3736eb3-7f78-45df-a90a-56e1f072b85c service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:55.812873 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-0175f222-5da3-4fe1-95ff-b5c549d4bd13 req-e3736eb3-7f78-45df-a90a-56e1f072b85c service nova] Creating event network-vif-plugged:fb44d1d7-b555-4a7c-9246-8f035d594d28 for instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 on hv-cinder-83735 Jun 16 16:21:55.818007 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-0175f222-5da3-4fe1-95ff-b5c549d4bd13 req-e3736eb3-7f78-45df-a90a-56e1f072b85c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035957 Jun 16 16:21:55.818718 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 499/997] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:55.869334 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3d77db50-b382-4abc-a7e9-62295ba36c46 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:55.869984 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3d77db50-b382-4abc-a7e9-62295ba36c46 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:55.876862 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3d77db50-b382-4abc-a7e9-62295ba36c46 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:55.877319 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3d77db50-b382-4abc-a7e9-62295ba36c46 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:55.878138 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3d77db50-b382-4abc-a7e9-62295ba36c46 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:55.878761 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3d77db50-b382-4abc-a7e9-62295ba36c46 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:55.973479 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3d77db50-b382-4abc-a7e9-62295ba36c46 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:55.982939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3d77db50-b382-4abc-a7e9-62295ba36c46 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1381 microversion: 2.1 time: 0.136418 Jun 16 16:21:55.983875 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 499/998] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:55 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1381 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:56.030437 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b810b821-8558-4c92-b14d-6c956ec6976b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:56.031227 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b810b821-8558-4c92-b14d-6c956ec6976b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:56.037835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b810b821-8558-4c92-b14d-6c956ec6976b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:56.038320 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b810b821-8558-4c92-b14d-6c956ec6976b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:56.039095 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b810b821-8558-4c92-b14d-6c956ec6976b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:56.039533 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b810b821-8558-4c92-b14d-6c956ec6976b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:56.057376 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-698502f1-950a-42e7-b60f-227c53411c95 req-00c44143-1e77-45b2-ab46-23df81e2ce2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c92e5c48-0ac8-4a24-9e6b-019b7825b0b4", "name": "network-vif-deleted", "tag": "fd0e55d6-c023-4540-8b9f-28e600c52b4f"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:56.068298 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-698502f1-950a-42e7-b60f-227c53411c95 req-00c44143-1e77-45b2-ab46-23df81e2ce2f service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:56.068846 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-698502f1-950a-42e7-b60f-227c53411c95 req-00c44143-1e77-45b2-ab46-23df81e2ce2f service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:56.081585 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-698502f1-950a-42e7-b60f-227c53411c95 req-00c44143-1e77-45b2-ab46-23df81e2ce2f service nova] Creating event network-vif-deleted:fd0e55d6-c023-4540-8b9f-28e600c52b4f for instance c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 on hv-cinder-83735 Jun 16 16:21:56.087019 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-698502f1-950a-42e7-b60f-227c53411c95 req-00c44143-1e77-45b2-ab46-23df81e2ce2f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034273 Jun 16 16:21:56.087834 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 500/999] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:21:56.209391 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b810b821-8558-4c92-b14d-6c956ec6976b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:56.217377 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b810b821-8558-4c92-b14d-6c956ec6976b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1363 microversion: 2.1 time: 0.191252 Jun 16 16:21:56.217977 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 500/1000] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:56 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:21:56.996721 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:56.997582 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=6 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:57.002330 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-599377fa-47a5-4135-84d0-ad0a0bb28171 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:57.003217 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-599377fa-47a5-4135-84d0-ad0a0bb28171 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:57.011150 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-599377fa-47a5-4135-84d0-ad0a0bb28171 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:57.011607 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-599377fa-47a5-4135-84d0-ad0a0bb28171 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:57.012376 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-599377fa-47a5-4135-84d0-ad0a0bb28171 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:57.012830 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-599377fa-47a5-4135-84d0-ad0a0bb28171 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:57.046681 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-599377fa-47a5-4135-84d0-ad0a0bb28171 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:57.047136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-599377fa-47a5-4135-84d0-ad0a0bb28171 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:57.047586 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-599377fa-47a5-4135-84d0-ad0a0bb28171 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lazy-loading 'fault' on Instance uuid c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:21:57.094130 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-599377fa-47a5-4135-84d0-ad0a0bb28171 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:57.102345 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-599377fa-47a5-4135-84d0-ad0a0bb28171 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1224 microversion: 2.1 time: 0.106531 Jun 16 16:21:57.102913 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 501/1001] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:56 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:57.234521 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9959de25-d196-469a-b7f3-54123a721c85 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:57.235056 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9959de25-d196-469a-b7f3-54123a721c85 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:57.237046 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=6 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:57.243818 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9959de25-d196-469a-b7f3-54123a721c85 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:57.244257 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9959de25-d196-469a-b7f3-54123a721c85 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:57.245006 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9959de25-d196-469a-b7f3-54123a721c85 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:57.245434 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9959de25-d196-469a-b7f3-54123a721c85 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:57.376767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9959de25-d196-469a-b7f3-54123a721c85 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:57.384599 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9959de25-d196-469a-b7f3-54123a721c85 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1363 microversion: 2.1 time: 0.153978 Jun 16 16:21:57.385172 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 501/1002] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:57 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:58.120250 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9c611dda-060f-4dea-a119-fc5facc8bdff tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:58.120797 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9c611dda-060f-4dea-a119-fc5facc8bdff tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:58.126805 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c611dda-060f-4dea-a119-fc5facc8bdff tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:58.127247 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c611dda-060f-4dea-a119-fc5facc8bdff tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:58.128002 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c611dda-060f-4dea-a119-fc5facc8bdff tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:58.128435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c611dda-060f-4dea-a119-fc5facc8bdff tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:58.160574 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c611dda-060f-4dea-a119-fc5facc8bdff tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:58.161023 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c611dda-060f-4dea-a119-fc5facc8bdff tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:58.161466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-9c611dda-060f-4dea-a119-fc5facc8bdff tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lazy-loading 'fault' on Instance uuid c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:21:58.201663 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9c611dda-060f-4dea-a119-fc5facc8bdff tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578e9a80847d4fb18e9ea43a3ed7e8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed429e2356c4c7a83872d82c0540b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:58.209108 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9c611dda-060f-4dea-a119-fc5facc8bdff tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 200 len: 1224 microversion: 2.1 time: 0.093573 Jun 16 16:21:58.209734 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 502/1003] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:58 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:21:58.401938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6255eee3-256f-4214-b0e0-bfc525a296e0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:58.402464 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6255eee3-256f-4214-b0e0-bfc525a296e0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:58.409301 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6255eee3-256f-4214-b0e0-bfc525a296e0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:58.409834 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6255eee3-256f-4214-b0e0-bfc525a296e0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:58.410666 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6255eee3-256f-4214-b0e0-bfc525a296e0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:58.411147 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6255eee3-256f-4214-b0e0-bfc525a296e0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:58.544584 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6255eee3-256f-4214-b0e0-bfc525a296e0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:21:58.552417 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6255eee3-256f-4214-b0e0-bfc525a296e0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1549 microversion: 2.1 time: 0.154823 Jun 16 16:21:58.552975 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 502/1004] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:58 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:21:58.569306 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-41df28fe-2466-4a91-b3e0-072e649cfb43 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:58.569847 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-41df28fe-2466-4a91-b3e0-072e649cfb43 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:58.576371 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-41df28fe-2466-4a91-b3e0-072e649cfb43 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:58.576825 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-41df28fe-2466-4a91-b3e0-072e649cfb43 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:58.577593 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-41df28fe-2466-4a91-b3e0-072e649cfb43 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:58.578064 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-41df28fe-2466-4a91-b3e0-072e649cfb43 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:58.657294 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-41df28fe-2466-4a91-b3e0-072e649cfb43 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091861 Jun 16 16:21:58.657938 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 503/1005] 10.222.0.88 () {58 vars in 1274 bytes} [Thu Jun 16 16:21:58 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:21:59.226414 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3447beff-3266-47b3-bb9a-365b24d4fd23 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:59.227156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3447beff-3266-47b3-bb9a-365b24d4fd23 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] [instance: c92e5c48-0ac8-4a24-9e6b-019b7825b0b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:21:59.234174 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3447beff-3266-47b3-bb9a-365b24d4fd23 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:59.234622 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3447beff-3266-47b3-bb9a-365b24d4fd23 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:59.235426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3447beff-3266-47b3-bb9a-365b24d4fd23 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:59.235846 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3447beff-3266-47b3-bb9a-365b24d4fd23 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:59.250775 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-3447beff-3266-47b3-bb9a-365b24d4fd23 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] HTTP exception thrown: Instance c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 could not be found. Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3447beff-3266-47b3-bb9a-365b24d4fd23 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Request method failure captured: Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 HTTP/1.1 Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1bAmRo5CDLY8zC6djzTPMecImDTMA8IpqLLG7ezeGO8I0hHKIz_w-XKOqK1dpWZ4wITPYRj8T5DVhYugWqDgnLiZWokLOa7CO6dw9e9vrsexaj4WBzu7ZI-Rr20moKBtMWPTF0cDB8tKq6cxRpG_LlE6QFRpYKBvy-R5ovCfJcMQxQ Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: aed429e2356c4c7a83872d82c0540b66 Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-TestShelveInstance-961707879 Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:21:59.252448 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:21:59.253966 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/aed429e2356c4c7a83872d82c0540b66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/aed429e2356c4c7a83872d82c0540b66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_aed429e2356c4c7a83872d82c0540b66", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/aed429e2356c4c7a83872d82c0540b66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:21:59.253966 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-TestShelveInstance-961707879 Jun 16 16:21:59.253966 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: aed429e2356c4c7a83872d82c0540b66 Jun 16 16:21:59.253966 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-TestShelveInstance-961707879 Jun 16 16:21:59.253966 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-TestShelveInstance-961707879-project Jun 16 16:21:59.253966 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:21:59.253966 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:21:59.253966 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: 578e9a80847d4fb18e9ea43a3ed7e8f5 Jun 16 16:21:59.253966 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-TestShelveInstance-961707879-project Jun 16 16:21:59.253966 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:21:59.253966 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 could not be found. Jun 16 16:21:59.253966 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': 'c92e5c48-0ac8-4a24-9e6b-019b7825b0b4'} Jun 16 16:21:59.254840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:21:59.254840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:21:59.254840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:21:59.254840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:21:59.254840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:21:59.254840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:21:59.254840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:21:59.254840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:21:59.254840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:21:59.254840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:21:59.254840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 could not be found. Jun 16 16:21:59.254840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:21:59.254840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:21:59.254840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:21:59.254840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:21:59.254840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:21:59.254840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:21:59.254840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:21:59.254840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:21:59.254840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:21:59.256176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:21:59.256176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:21:59.256176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:21:59.256176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:21:59.256176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:21:59.256176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:21:59.256176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:21:59.256176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 could not be found. Jun 16 16:21:59.256176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:21:59.256176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:21:59.256176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:21:59.256176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:21:59.256176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:21:59.256176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:21:59.256176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:21:59.256176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:21:59.256176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 could not be found. Jun 16 16:21:59.256176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:21:59.257387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3447beff-3266-47b3-bb9a-365b24d4fd23 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Returning 404 to user: Instance c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:21:59.257387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3447beff-3266-47b3-bb9a-365b24d4fd23 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4" status: 404 len: 111 microversion: 2.1 time: 0.031818 Jun 16 16:21:59.257387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 503/1006] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:21:59 2022] GET /compute/v2.1/servers/c92e5c48-0ac8-4a24-9e6b-019b7825b0b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:21:59.431677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b40821a3-d778-4d31-9d4a-62c8f5259c70 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] Calling method '.version_select at 0x7f6f0d1c8f70>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:21:59.457378 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b40821a3-d778-4d31-9d4a-62c8f5259c70 tempest-TestShelveInstance-961707879 tempest-TestShelveInstance-961707879-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-945213920" status: 202 len: 0 microversion: 2.1 time: 0.029625 Jun 16 16:21:59.458538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 504/1007] 10.222.0.88 () {58 vars in 1250 bytes} [Thu Jun 16 16:21:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-945213920 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:21:59.853177 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-d90b601a-61af-4769-9cd7-7138accc4014 req-01854be7-3fb1-4798-a665-4418f3f61a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0f7646-c731-405a-ac41-0e889b5fdb56", "tag": "fb44d1d7-b555-4a7c-9246-8f035d594d28"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:21:59.861827 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-d90b601a-61af-4769-9cd7-7138accc4014 req-01854be7-3fb1-4798-a665-4418f3f61a5d service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:21:59.862275 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-d90b601a-61af-4769-9cd7-7138accc4014 req-01854be7-3fb1-4798-a665-4418f3f61a5d service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:21:59.873645 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-d90b601a-61af-4769-9cd7-7138accc4014 req-01854be7-3fb1-4798-a665-4418f3f61a5d service nova] Creating event network-changed:fb44d1d7-b555-4a7c-9246-8f035d594d28 for instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 on hv-cinder-83735 Jun 16 16:21:59.878768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-d90b601a-61af-4769-9cd7-7138accc4014 req-01854be7-3fb1-4798-a665-4418f3f61a5d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029988 Jun 16 16:21:59.879650 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 504/1008] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:22:10.257601 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:10.258988 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:10.263584 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1cbeac04-62e0-4bfe-9238-57eb21c8db79 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:10.264082 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1cbeac04-62e0-4bfe-9238-57eb21c8db79 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:10.272384 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1cbeac04-62e0-4bfe-9238-57eb21c8db79 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:10.272836 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1cbeac04-62e0-4bfe-9238-57eb21c8db79 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:10.273602 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1cbeac04-62e0-4bfe-9238-57eb21c8db79 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:10.274068 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1cbeac04-62e0-4bfe-9238-57eb21c8db79 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:10.300795 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1cbeac04-62e0-4bfe-9238-57eb21c8db79 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4/ips" status: 200 len: 150 microversion: 2.1 time: 0.044556 Jun 16 16:22:10.301374 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 505/1009] 10.222.0.88 () {58 vars in 1247 bytes} [Thu Jun 16 16:22:10 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:22:12.663851 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:12.665543 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=56 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:12.669866 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8e53fd86-af3a-4a49-9dcd-fe3d8d5c0e08 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69cf4da0-85d2-4834-b102-572ad03d2974"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:22:12.671018 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8e53fd86-af3a-4a49-9dcd-fe3d8d5c0e08 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:12.678735 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8e53fd86-af3a-4a49-9dcd-fe3d8d5c0e08 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:12.679189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8e53fd86-af3a-4a49-9dcd-fe3d8d5c0e08 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:12.680053 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8e53fd86-af3a-4a49-9dcd-fe3d8d5c0e08 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:12.681013 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8e53fd86-af3a-4a49-9dcd-fe3d8d5c0e08 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:12.943004 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8e53fd86-af3a-4a49-9dcd-fe3d8d5c0e08 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "POST /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280683 Jun 16 16:22:12.943642 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 505/1010] 10.222.0.88 () {60 vars in 1322 bytes} [Thu Jun 16 16:22:12 2022] POST /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:22:20.436372 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0a067440-1d0c-44df-bdc2-348e1d0cf965 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69cf4da0-85d2-4834-b102-572ad03d2974"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:22:20.437435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0a067440-1d0c-44df-bdc2-348e1d0cf965 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:20.439781 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:20.440401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=4 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:20.446491 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0a067440-1d0c-44df-bdc2-348e1d0cf965 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:20.447018 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0a067440-1d0c-44df-bdc2-348e1d0cf965 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:20.447776 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0a067440-1d0c-44df-bdc2-348e1d0cf965 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:20.448207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0a067440-1d0c-44df-bdc2-348e1d0cf965 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:20.527457 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-0a067440-1d0c-44df-bdc2-348e1d0cf965 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] HTTP exception thrown: Invalid volume: volume 69cf4da0-85d2-4834-b102-572ad03d2974 is already attached to instances: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0a067440-1d0c-44df-bdc2-348e1d0cf965 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Request method failure captured: Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: POST /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4/os-volume_attachments HTTP/1.1 Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 74 Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1Z8eNcA8LvE_QGupE8IwZgqoLdb4bdar2JFxF-sM8vVrpRiD1EIWMp99ewnT5la5EmpgmBAQZOsVfs3XmSmDWWlPn9Df8pyp8HGhxHfE9ShSTZ5F3NEdcePS6LELsIFGFBpMHeDDC0nVbCEOCxMglGuS8woh2jjuJT6Oy7NXlIFCC8 Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:22:20.529246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:22:20.530733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c1cdf363c2e44af5b0d8cd748c58235b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:22:20.530733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:22:20.530733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:22:20.530733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:22:20.530733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:22:20.530733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:22:20.530733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:22:20.530733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: bfbcc9b45bc341228bcc0f2192040224 Jun 16 16:22:20.530733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:22:20.530733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Jun 16 16:22:20.530733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {"volumeAttachment": {"volumeId": "69cf4da0-85d2-4834-b102-572ad03d2974"}} Jun 16 16:22:20.530733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:22:20.531506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Invalid volume: volume 69cf4da0-85d2-4834-b102-572ad03d2974 is already attached to instances: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 Jun 16 16:22:20.531506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'server_id': '17331aa3-ceef-4afb-9a61-a7bc981e5fa4', 'body': {'volumeAttachment': {'volumeId': '69cf4da0-85d2-4834-b102-572ad03d2974'}}} Jun 16 16:22:20.531506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:22:20.531506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:22:20.531506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 16:22:20.531506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 16:22:20.531506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 16:22:20.531506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 16:22:20.531506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 16:22:20.531506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 16:22:20.531506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 16:22:20.531506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 16:22:20.531506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 16:22:20.531506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 16:22:20.531506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 69cf4da0-85d2-4834-b102-572ad03d2974 is already attached to instances: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 Jun 16 16:22:20.531506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:22:20.531506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:22:20.531506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:22:20.531506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:22:20.532789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:22:20.532789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:22:20.532789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:22:20.532789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:22:20.532789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:22:20.532789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:22:20.532789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:22:20.532789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:22:20.532789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:22:20.532789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:22:20.532789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:22:20.532789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:22:20.532789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 16:22:20.532789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 16:22:20.532789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 69cf4da0-85d2-4834-b102-572ad03d2974 is already attached to instances: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 Jun 16 16:22:20.532789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:22:20.532789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:22:20.532789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:22:20.532789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:22:20.532789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:22:20.534106 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:22:20.534106 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:22:20.534106 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:22:20.534106 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 69cf4da0-85d2-4834-b102-572ad03d2974 is already attached to instances: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 Jun 16 16:22:20.534106 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:22:20.534106 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0a067440-1d0c-44df-bdc2-348e1d0cf965 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Returning 400 to user: Invalid volume: volume 69cf4da0-85d2-4834-b102-572ad03d2974 is already attached to instances: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:22:20.534106 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0a067440-1d0c-44df-bdc2-348e1d0cf965 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "POST /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098308 Jun 16 16:22:20.534106 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 506/1011] 10.222.0.88 () {60 vars in 1322 bytes} [Thu Jun 16 16:22:20 2022] POST /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:22:20.592889 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8b938c8b-bd00-42c6-a6f2-40993486c2ce tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:20.593384 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8b938c8b-bd00-42c6-a6f2-40993486c2ce tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:20.599783 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8b938c8b-bd00-42c6-a6f2-40993486c2ce tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:20.600226 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8b938c8b-bd00-42c6-a6f2-40993486c2ce tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:20.600967 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8b938c8b-bd00-42c6-a6f2-40993486c2ce tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:20.601420 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8b938c8b-bd00-42c6-a6f2-40993486c2ce tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:20.678146 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-8b938c8b-bd00-42c6-a6f2-40993486c2ce tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lazy-loading 'services' on Instance uuid 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:22:20.749209 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8b938c8b-bd00-42c6-a6f2-40993486c2ce tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "DELETE /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4/os-volume_attachments/69cf4da0-85d2-4834-b102-572ad03d2974" status: 202 len: 0 microversion: 2.1 time: 0.160893 Jun 16 16:22:20.749946 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 506/1012] 10.222.0.88 () {58 vars in 1415 bytes} [Thu Jun 16 16:22:20 2022] DELETE /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4/os-volume_attachments/69cf4da0-85d2-4834-b102-572ad03d2974 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:22:20.758685 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0ef32290-968c-460b-ba05-de01ad3bd9fe tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:20.759607 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0ef32290-968c-460b-ba05-de01ad3bd9fe tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:20.766490 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0ef32290-968c-460b-ba05-de01ad3bd9fe tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:20.767210 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0ef32290-968c-460b-ba05-de01ad3bd9fe tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:20.767993 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0ef32290-968c-460b-ba05-de01ad3bd9fe tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:20.768436 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0ef32290-968c-460b-ba05-de01ad3bd9fe tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:20.797777 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0ef32290-968c-460b-ba05-de01ad3bd9fe tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043498 Jun 16 16:22:20.798343 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 507/1013] 10.222.0.88 () {58 vars in 1301 bytes} [Thu Jun 16 16:22:20 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:22:21.343119 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7dd43920-dc93-4ef9-959f-cf7aafce23f3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:21.343704 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7dd43920-dc93-4ef9-959f-cf7aafce23f3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:21.350474 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7dd43920-dc93-4ef9-959f-cf7aafce23f3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:21.350928 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7dd43920-dc93-4ef9-959f-cf7aafce23f3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:21.352182 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7dd43920-dc93-4ef9-959f-cf7aafce23f3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:21.352621 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7dd43920-dc93-4ef9-959f-cf7aafce23f3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:21.376431 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7dd43920-dc93-4ef9-959f-cf7aafce23f3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4/ips" status: 200 len: 152 microversion: 2.20 time: 0.037953 Jun 16 16:22:21.377011 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 507/1014] 10.222.0.88 () {60 vars in 1288 bytes} [Thu Jun 16 16:22:21 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:22:21.809838 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fbba5b50-ad26-48fb-a573-0148767b2e54 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:21.810772 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fbba5b50-ad26-48fb-a573-0148767b2e54 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:21.818216 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fbba5b50-ad26-48fb-a573-0148767b2e54 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:21.818659 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fbba5b50-ad26-48fb-a573-0148767b2e54 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:21.819417 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fbba5b50-ad26-48fb-a573-0148767b2e54 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:21.819900 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fbba5b50-ad26-48fb-a573-0148767b2e54 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:21.851478 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fbba5b50-ad26-48fb-a573-0148767b2e54 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046136 Jun 16 16:22:21.852559 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 508/1015] 10.222.0.88 () {58 vars in 1301 bytes} [Thu Jun 16 16:22:21 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:22:21.910234 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-abf8855a-6ddb-4f7d-a826-cd45d0dbb511 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:21.910750 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-abf8855a-6ddb-4f7d-a826-cd45d0dbb511 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:21.918629 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-abf8855a-6ddb-4f7d-a826-cd45d0dbb511 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:21.919019 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-abf8855a-6ddb-4f7d-a826-cd45d0dbb511 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:21.920036 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-abf8855a-6ddb-4f7d-a826-cd45d0dbb511 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:21.920512 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-abf8855a-6ddb-4f7d-a826-cd45d0dbb511 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:21.945870 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-abf8855a-6ddb-4f7d-a826-cd45d0dbb511 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:22:22.023237 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-abf8855a-6ddb-4f7d-a826-cd45d0dbb511 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "DELETE /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 204 len: 0 microversion: 2.1 time: 0.116478 Jun 16 16:22:22.024426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 508/1016] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:22:21 2022] DELETE /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:22:22.032660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e2746541-7473-439b-9642-80670c638d00 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:22.033275 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e2746541-7473-439b-9642-80670c638d00 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:22.039782 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e2746541-7473-439b-9642-80670c638d00 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:22.040236 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e2746541-7473-439b-9642-80670c638d00 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:22.041003 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e2746541-7473-439b-9642-80670c638d00 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:22.041441 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e2746541-7473-439b-9642-80670c638d00 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:22.170762 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e2746541-7473-439b-9642-80670c638d00 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:22.178133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e2746541-7473-439b-9642-80670c638d00 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 200 len: 1682 microversion: 2.1 time: 0.149289 Jun 16 16:22:22.178697 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 509/1017] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:22:22 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:22:23.196243 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f737983a-7d4e-4a04-af7f-4fa9b94079d5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:23.196963 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f737983a-7d4e-4a04-af7f-4fa9b94079d5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:23.203652 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f737983a-7d4e-4a04-af7f-4fa9b94079d5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:23.204092 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f737983a-7d4e-4a04-af7f-4fa9b94079d5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:23.204843 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f737983a-7d4e-4a04-af7f-4fa9b94079d5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:23.205273 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f737983a-7d4e-4a04-af7f-4fa9b94079d5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:23.552916 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f737983a-7d4e-4a04-af7f-4fa9b94079d5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:23.560859 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f737983a-7d4e-4a04-af7f-4fa9b94079d5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 200 len: 1682 microversion: 2.1 time: 0.368862 Jun 16 16:22:23.561420 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 509/1018] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:22:23 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 1682 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:22:24.232459 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4e9dc573-a2fa-4499-b3ba-6a674f6fc434 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:22:24.233028 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4e9dc573-a2fa-4499-b3ba-6a674f6fc434 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:24.239948 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4e9dc573-a2fa-4499-b3ba-6a674f6fc434 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:24.240410 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4e9dc573-a2fa-4499-b3ba-6a674f6fc434 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:24.241184 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4e9dc573-a2fa-4499-b3ba-6a674f6fc434 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:24.241623 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4e9dc573-a2fa-4499-b3ba-6a674f6fc434 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:24.265677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-4e9dc573-a2fa-4499-b3ba-6a674f6fc434 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lazy-loading 'flavor' on Instance uuid 38f151b6-bfce-4c42-932f-7be72f7da4b4 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:22:24.520020 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4e9dc573-a2fa-4499-b3ba-6a674f6fc434 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "POST /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4/action" status: 202 len: 0 microversion: 2.20 time: 0.291272 Jun 16 16:22:24.520791 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 510/1019] 10.222.0.88 () {62 vars in 1318 bytes} [Thu Jun 16 16:22:24 2022] POST /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:22:24.529790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5b93f5ba-498b-4b91-98e7-3d7ce20ca993 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:24.530192 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5b93f5ba-498b-4b91-98e7-3d7ce20ca993 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:24.537580 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5b93f5ba-498b-4b91-98e7-3d7ce20ca993 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:24.538132 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5b93f5ba-498b-4b91-98e7-3d7ce20ca993 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:24.539485 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5b93f5ba-498b-4b91-98e7-3d7ce20ca993 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:24.540106 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5b93f5ba-498b-4b91-98e7-3d7ce20ca993 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:24.579103 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0f6296f7-8dab-40e5-b5a9-134ceac934c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:24.579810 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0f6296f7-8dab-40e5-b5a9-134ceac934c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:24.589670 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0f6296f7-8dab-40e5-b5a9-134ceac934c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:24.590165 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0f6296f7-8dab-40e5-b5a9-134ceac934c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:24.590956 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0f6296f7-8dab-40e5-b5a9-134ceac934c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:24.591394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0f6296f7-8dab-40e5-b5a9-134ceac934c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:24.710741 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5b93f5ba-498b-4b91-98e7-3d7ce20ca993 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:24.718870 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5b93f5ba-498b-4b91-98e7-3d7ce20ca993 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:24.720377 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5b93f5ba-498b-4b91-98e7-3d7ce20ca993 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:24.721559 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5b93f5ba-498b-4b91-98e7-3d7ce20ca993 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1724 microversion: 2.20 time: 0.195997 Jun 16 16:22:24.722143 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 510/1020] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:24 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:24.765688 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0f6296f7-8dab-40e5-b5a9-134ceac934c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:24.773918 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0f6296f7-8dab-40e5-b5a9-134ceac934c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 200 len: 1682 microversion: 2.1 time: 0.198571 Jun 16 16:22:24.774485 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 511/1021] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:22:24 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 1682 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:22:25.592368 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-6ca7aee0-7c4d-4432-940f-6198547431c6 req-797a6093-4218-41f0-b8ea-207b5374110f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17331aa3-ceef-4afb-9a61-a7bc981e5fa4", "name": "network-vif-deleted", "tag": "e39c301b-1099-43a0-9e6f-cc8fbcf288d7"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:22:25.601392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-6ca7aee0-7c4d-4432-940f-6198547431c6 req-797a6093-4218-41f0-b8ea-207b5374110f service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:25.601779 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-6ca7aee0-7c4d-4432-940f-6198547431c6 req-797a6093-4218-41f0-b8ea-207b5374110f service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:25.615138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-6ca7aee0-7c4d-4432-940f-6198547431c6 req-797a6093-4218-41f0-b8ea-207b5374110f service nova] Creating event network-vif-deleted:e39c301b-1099-43a0-9e6f-cc8fbcf288d7 for instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 on hv-cinder-83735 Jun 16 16:22:25.620577 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-6ca7aee0-7c4d-4432-940f-6198547431c6 req-797a6093-4218-41f0-b8ea-207b5374110f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031829 Jun 16 16:22:25.621189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 511/1022] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:22:25.739938 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-374d13fc-04c2-48cb-a1f2-3188830b11f1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:25.740571 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-374d13fc-04c2-48cb-a1f2-3188830b11f1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:25.747890 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-374d13fc-04c2-48cb-a1f2-3188830b11f1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:25.748336 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-374d13fc-04c2-48cb-a1f2-3188830b11f1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:25.749108 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-374d13fc-04c2-48cb-a1f2-3188830b11f1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:25.749536 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-374d13fc-04c2-48cb-a1f2-3188830b11f1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:25.794551 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-436df960-17ef-4c37-9134-eff497d3c150 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:25.795538 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-436df960-17ef-4c37-9134-eff497d3c150 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:25.808441 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-436df960-17ef-4c37-9134-eff497d3c150 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:25.809078 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-436df960-17ef-4c37-9134-eff497d3c150 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:25.810085 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-436df960-17ef-4c37-9134-eff497d3c150 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:25.810682 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-436df960-17ef-4c37-9134-eff497d3c150 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:25.844889 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-436df960-17ef-4c37-9134-eff497d3c150 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:25.845463 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-436df960-17ef-4c37-9134-eff497d3c150 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:25.845793 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-436df960-17ef-4c37-9134-eff497d3c150 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lazy-loading 'fault' on Instance uuid 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:22:25.898207 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-436df960-17ef-4c37-9134-eff497d3c150 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:25.906405 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-436df960-17ef-4c37-9134-eff497d3c150 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 200 len: 1331 microversion: 2.1 time: 0.119056 Jun 16 16:22:25.906965 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 512/1023] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:22:25 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 1331 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:22:25.932133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-374d13fc-04c2-48cb-a1f2-3188830b11f1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:25.940116 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-374d13fc-04c2-48cb-a1f2-3188830b11f1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:25.941634 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-374d13fc-04c2-48cb-a1f2-3188830b11f1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:25.942837 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-374d13fc-04c2-48cb-a1f2-3188830b11f1 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1724 microversion: 2.20 time: 0.206812 Jun 16 16:22:25.943399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 512/1024] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:25 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:26.923258 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-262459c8-27e8-43cc-8499-92aa5eb31be6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:26.923854 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-262459c8-27e8-43cc-8499-92aa5eb31be6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:26.930339 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-262459c8-27e8-43cc-8499-92aa5eb31be6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:26.930786 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-262459c8-27e8-43cc-8499-92aa5eb31be6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:26.931528 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-262459c8-27e8-43cc-8499-92aa5eb31be6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:26.931957 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-262459c8-27e8-43cc-8499-92aa5eb31be6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:26.945781 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-262459c8-27e8-43cc-8499-92aa5eb31be6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] HTTP exception thrown: Instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 could not be found. Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-262459c8-27e8-43cc-8499-92aa5eb31be6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Request method failure captured: Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 HTTP/1.1 Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1Z8eNcA8LvE_QGupE8IwZgqoLdb4bdar2JFxF-sM8vVrpRiD1EIWMp99ewnT5la5EmpgmBAQZOsVfs3XmSmDWWlPn9Df8pyp8HGhxHfE9ShSTZ5F3NEdcePS6LELsIFGFBpMHeDDC0nVbCEOCxMglGuS8woh2jjuJT6Oy7NXlIFCC8 Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:22:26.947450 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:22:26.948976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c1cdf363c2e44af5b0d8cd748c58235b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:22:26.948976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:22:26.948976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:22:26.948976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:22:26.948976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:22:26.948976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:22:26.948976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:22:26.948976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: bfbcc9b45bc341228bcc0f2192040224 Jun 16 16:22:26.948976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:22:26.948976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:22:26.948976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 could not be found. Jun 16 16:22:26.948976 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '17331aa3-ceef-4afb-9a61-a7bc981e5fa4'} Jun 16 16:22:26.950003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:22:26.950003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:22:26.950003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:22:26.950003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:22:26.950003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:22:26.950003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:22:26.950003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:22:26.950003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:22:26.950003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:22:26.950003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:22:26.950003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 could not be found. Jun 16 16:22:26.950003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:22:26.950003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:22:26.950003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:22:26.950003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:22:26.950003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:22:26.950003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:22:26.950003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:22:26.950003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:22:26.950003 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:22:26.951491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:22:26.951491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:22:26.951491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:22:26.951491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:22:26.951491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:22:26.951491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:22:26.951491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:22:26.951491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 could not be found. Jun 16 16:22:26.951491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:22:26.951491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:22:26.951491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:22:26.951491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:22:26.951491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:22:26.951491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:22:26.951491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:22:26.951491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:22:26.951491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 could not be found. Jun 16 16:22:26.951491 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:22:26.952778 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-262459c8-27e8-43cc-8499-92aa5eb31be6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Returning 404 to user: Instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:22:26.952778 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-262459c8-27e8-43cc-8499-92aa5eb31be6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 404 len: 111 microversion: 2.1 time: 0.029419 Jun 16 16:22:26.952778 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 513/1025] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:22:26 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:22:26.958251 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-52465011-3ac0-4d35-9b17-21d40c809869 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '.version_select at 0x7f6f0d1d13a0>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:26.959946 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-38131cb6-1ce5-4729-a60c-231bfdf4566e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:26.960559 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-38131cb6-1ce5-4729-a60c-231bfdf4566e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:26.967258 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-38131cb6-1ce5-4729-a60c-231bfdf4566e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:26.967711 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-38131cb6-1ce5-4729-a60c-231bfdf4566e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:26.968482 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-38131cb6-1ce5-4729-a60c-231bfdf4566e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:26.968917 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-38131cb6-1ce5-4729-a60c-231bfdf4566e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:26.977427 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-52465011-3ac0-4d35-9b17-21d40c809869 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672480584" status: 202 len: 0 microversion: 2.1 time: 0.022944 Jun 16 16:22:26.978060 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 513/1026] 10.222.0.88 () {58 vars in 1220 bytes} [Thu Jun 16 16:22:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672480584 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:22:27.102969 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-38131cb6-1ce5-4729-a60c-231bfdf4566e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:27.111060 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-38131cb6-1ce5-4729-a60c-231bfdf4566e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:27.112867 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-38131cb6-1ce5-4729-a60c-231bfdf4566e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:27.114268 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-38131cb6-1ce5-4729-a60c-231bfdf4566e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1724 microversion: 2.20 time: 0.158034 Jun 16 16:22:27.114897 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 514/1027] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:26 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:22:27.585176 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-90032942-66e0-4c15-90e9-ff1f2beb8148 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Action: 'create', calling method: .version_select at 0x7f6f0f923af0>, body: {"keypair": {"name": "tempest-keypair-1593409325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrV5Mtkw5ETeNPPtY2OivTk+4VGAr13mDCRQ6faA9ZAGT9Gpm/DaDVycEY0iV6BcQnVfjvIdi9J59OO04qSVz2YDatWVhHI3pAPxZ/IGgkG8SqRpeX5zlweY2PGWlyQ/A=="}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:22:27.600203 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-90032942-66e0-4c15-90e9-ff1f2beb8148 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Getting quotas for project c1cdf363c2e44af5b0d8cd748c58235b. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:22:27.603992 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-90032942-66e0-4c15-90e9-ff1f2beb8148 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Getting quotas for user bfbcc9b45bc341228bcc0f2192040224 and project c1cdf363c2e44af5b0d8cd748c58235b. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:22:27.625056 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-90032942-66e0-4c15-90e9-ff1f2beb8148 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043823 Jun 16 16:22:27.625685 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 514/1028] 10.222.0.88 () {60 vars in 1158 bytes} [Thu Jun 16 16:22:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:22:28.133172 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2f65dda5-6366-4499-ab4a-76dbad1b9194 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:28.133846 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2f65dda5-6366-4499-ab4a-76dbad1b9194 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:28.140770 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2f65dda5-6366-4499-ab4a-76dbad1b9194 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:28.141225 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2f65dda5-6366-4499-ab4a-76dbad1b9194 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:28.142021 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2f65dda5-6366-4499-ab4a-76dbad1b9194 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:28.142461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2f65dda5-6366-4499-ab4a-76dbad1b9194 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:28.275396 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2f65dda5-6366-4499-ab4a-76dbad1b9194 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:28.283595 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2f65dda5-6366-4499-ab4a-76dbad1b9194 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:28.292962 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2f65dda5-6366-4499-ab4a-76dbad1b9194 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:28.294246 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2f65dda5-6366-4499-ab4a-76dbad1b9194 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1724 microversion: 2.20 time: 0.165086 Jun 16 16:22:28.294794 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 515/1029] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:28 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:28.929488 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fbccaee1-063c-4db4-ad6d-713e05c176e6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2050147115", "imageRef": "d2716dc1-3d4d-4f62-b0af-c38986f2a3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4704a63-fabf-4303-b16d-892673b27ab3"}], "security_groups": [{"name": "tempest-securitygroup--749955635"}], "key_name": "tempest-keypair-1593409325", "user_data": "}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:22:29.134753 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-fbccaee1-063c-4db4-ad6d-713e05c176e6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] validate_networks() for [('b4704a63-fabf-4303-b16d-892673b27ab3', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:22:29.311383 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2d7d21a4-1948-4538-857e-a9e3a772b59c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:29.311990 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2d7d21a4-1948-4538-857e-a9e3a772b59c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:29.318380 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2d7d21a4-1948-4538-857e-a9e3a772b59c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:29.318823 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2d7d21a4-1948-4538-857e-a9e3a772b59c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:29.319573 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2d7d21a4-1948-4538-857e-a9e3a772b59c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:29.320542 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2d7d21a4-1948-4538-857e-a9e3a772b59c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:29.522474 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2d7d21a4-1948-4538-857e-a9e3a772b59c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:29.530321 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2d7d21a4-1948-4538-857e-a9e3a772b59c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:29.531819 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2d7d21a4-1948-4538-857e-a9e3a772b59c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:29.532979 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2d7d21a4-1948-4538-857e-a9e3a772b59c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1724 microversion: 2.20 time: 0.225445 Jun 16 16:22:29.533544 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 516/1030] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:29 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:22:29.580563 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-fbccaee1-063c-4db4-ad6d-713e05c176e6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:22:29.580988 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-fbccaee1-063c-4db4-ad6d-713e05c176e6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:22:29.581460 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-fbccaee1-063c-4db4-ad6d-713e05c176e6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:22:29.581900 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-fbccaee1-063c-4db4-ad6d-713e05c176e6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:22:29.582316 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-fbccaee1-063c-4db4-ad6d-713e05c176e6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:22:29.591633 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fbccaee1-063c-4db4-ad6d-713e05c176e6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:29.592075 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fbccaee1-063c-4db4-ad6d-713e05c176e6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:29.592868 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fbccaee1-063c-4db4-ad6d-713e05c176e6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:29.593302 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fbccaee1-063c-4db4-ad6d-713e05c176e6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:29.610226 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-fbccaee1-063c-4db4-ad6d-713e05c176e6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Getting quotas for project c1cdf363c2e44af5b0d8cd748c58235b. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:22:29.614210 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-fbccaee1-063c-4db4-ad6d-713e05c176e6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Getting quotas for user bfbcc9b45bc341228bcc0f2192040224 and project c1cdf363c2e44af5b0d8cd748c58235b. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:22:29.625477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fbccaee1-063c-4db4-ad6d-713e05c176e6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:22:29.627755 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fbccaee1-063c-4db4-ad6d-713e05c176e6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2716dc1-3d4d-4f62-b0af-c38986f2a3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:22:29.676762 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fbccaee1-063c-4db4-ad6d-713e05c176e6 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.751797 Jun 16 16:22:29.682983 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 515/1031] 10.222.0.88 () {60 vars in 1146 bytes} [Thu Jun 16 16:22:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:22:29.688218 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5ac9754b-95f2-4016-9b1a-a84f0074c2e2 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:29.688995 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5ac9754b-95f2-4016-9b1a-a84f0074c2e2 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:29.749607 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5ac9754b-95f2-4016-9b1a-a84f0074c2e2 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:29.759338 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5ac9754b-95f2-4016-9b1a-a84f0074c2e2 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 200 len: 1242 microversion: 2.1 time: 0.074922 Jun 16 16:22:29.760286 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 517/1032] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:22:29 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:22:30.551587 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-226c0bec-5f09-43cd-a6f3-e5e41fd4a134 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:30.552309 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-226c0bec-5f09-43cd-a6f3-e5e41fd4a134 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:30.559760 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-226c0bec-5f09-43cd-a6f3-e5e41fd4a134 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:30.560199 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-226c0bec-5f09-43cd-a6f3-e5e41fd4a134 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:30.560985 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-226c0bec-5f09-43cd-a6f3-e5e41fd4a134 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:30.561417 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-226c0bec-5f09-43cd-a6f3-e5e41fd4a134 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:30.719369 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-226c0bec-5f09-43cd-a6f3-e5e41fd4a134 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:30.728016 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-226c0bec-5f09-43cd-a6f3-e5e41fd4a134 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:30.729646 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-226c0bec-5f09-43cd-a6f3-e5e41fd4a134 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:30.730734 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-226c0bec-5f09-43cd-a6f3-e5e41fd4a134 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1724 microversion: 2.20 time: 0.183523 Jun 16 16:22:30.731496 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 516/1033] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:30 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:30.776553 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c9e04960-86f7-4ffd-a7f1-4b1fbd9ddee3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:30.777158 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c9e04960-86f7-4ffd-a7f1-4b1fbd9ddee3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:30.783722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c9e04960-86f7-4ffd-a7f1-4b1fbd9ddee3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:30.784187 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c9e04960-86f7-4ffd-a7f1-4b1fbd9ddee3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:30.784958 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c9e04960-86f7-4ffd-a7f1-4b1fbd9ddee3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:30.785397 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c9e04960-86f7-4ffd-a7f1-4b1fbd9ddee3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:30.856381 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c9e04960-86f7-4ffd-a7f1-4b1fbd9ddee3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:30.864072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c9e04960-86f7-4ffd-a7f1-4b1fbd9ddee3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 200 len: 1312 microversion: 2.1 time: 0.091459 Jun 16 16:22:30.864831 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 518/1034] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:22:30 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 1312 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:22:31.748712 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1be2ace9-9256-4c12-bec6-12948be35651 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:31.749980 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1be2ace9-9256-4c12-bec6-12948be35651 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:31.756556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1be2ace9-9256-4c12-bec6-12948be35651 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:31.757081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1be2ace9-9256-4c12-bec6-12948be35651 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:31.758438 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1be2ace9-9256-4c12-bec6-12948be35651 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:31.758872 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1be2ace9-9256-4c12-bec6-12948be35651 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:31.881888 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-71d274a1-5a1a-4235-8ddf-f043b6761dd9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:31.883005 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-71d274a1-5a1a-4235-8ddf-f043b6761dd9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:31.890533 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-71d274a1-5a1a-4235-8ddf-f043b6761dd9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:31.891044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-71d274a1-5a1a-4235-8ddf-f043b6761dd9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:31.891805 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-71d274a1-5a1a-4235-8ddf-f043b6761dd9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:31.892370 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-71d274a1-5a1a-4235-8ddf-f043b6761dd9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:32.013676 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1be2ace9-9256-4c12-bec6-12948be35651 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:32.021733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1be2ace9-9256-4c12-bec6-12948be35651 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:32.023815 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1be2ace9-9256-4c12-bec6-12948be35651 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:32.025061 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1be2ace9-9256-4c12-bec6-12948be35651 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1724 microversion: 2.20 time: 0.280168 Jun 16 16:22:32.025590 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 517/1035] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:31 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:32.152477 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-71d274a1-5a1a-4235-8ddf-f043b6761dd9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:32.160286 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-71d274a1-5a1a-4235-8ddf-f043b6761dd9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 200 len: 1367 microversion: 2.1 time: 0.282400 Jun 16 16:22:32.160855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 519/1036] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:22:31 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:22:32.549804 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-1c4aa3d2-674e-4193-8392-d160ac3bedd0 req-e6beb2fe-5861-4c60-b3f5-d28466384c38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a598febb-d1e1-4593-8547-bc0075f39338", "tag": "7d6dbef9-8302-4765-a850-0e7746870788"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:22:32.558828 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-1c4aa3d2-674e-4193-8392-d160ac3bedd0 req-e6beb2fe-5861-4c60-b3f5-d28466384c38 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:32.559281 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-1c4aa3d2-674e-4193-8392-d160ac3bedd0 req-e6beb2fe-5861-4c60-b3f5-d28466384c38 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:32.571997 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-1c4aa3d2-674e-4193-8392-d160ac3bedd0 req-e6beb2fe-5861-4c60-b3f5-d28466384c38 service nova] Creating event network-changed:7d6dbef9-8302-4765-a850-0e7746870788 for instance a598febb-d1e1-4593-8547-bc0075f39338 on hv-cinder-83735 Jun 16 16:22:32.587741 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-1c4aa3d2-674e-4193-8392-d160ac3bedd0 req-e6beb2fe-5861-4c60-b3f5-d28466384c38 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041621 Jun 16 16:22:32.589051 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 518/1037] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:22:33.043673 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b9ddeb65-7a91-4614-a21c-b79974702acd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:33.044219 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b9ddeb65-7a91-4614-a21c-b79974702acd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:33.050657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b9ddeb65-7a91-4614-a21c-b79974702acd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:33.051110 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b9ddeb65-7a91-4614-a21c-b79974702acd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:33.051866 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b9ddeb65-7a91-4614-a21c-b79974702acd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:33.052299 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b9ddeb65-7a91-4614-a21c-b79974702acd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:33.056843 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:33.178310 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0546dfc0-a662-4b66-88e3-eff5621a88c3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:33.179000 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0546dfc0-a662-4b66-88e3-eff5621a88c3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:33.185209 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0546dfc0-a662-4b66-88e3-eff5621a88c3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:33.185650 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0546dfc0-a662-4b66-88e3-eff5621a88c3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:33.186432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0546dfc0-a662-4b66-88e3-eff5621a88c3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:33.186861 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0546dfc0-a662-4b66-88e3-eff5621a88c3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:33.193278 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b9ddeb65-7a91-4614-a21c-b79974702acd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:33.201291 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b9ddeb65-7a91-4614-a21c-b79974702acd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:33.202808 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b9ddeb65-7a91-4614-a21c-b79974702acd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:33.203955 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b9ddeb65-7a91-4614-a21c-b79974702acd tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1724 microversion: 2.20 time: 0.164750 Jun 16 16:22:33.204513 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 520/1038] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:33 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:33.314952 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0546dfc0-a662-4b66-88e3-eff5621a88c3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:33.322974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0546dfc0-a662-4b66-88e3-eff5621a88c3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 200 len: 1367 microversion: 2.1 time: 0.149361 Jun 16 16:22:33.323540 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 519/1039] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:22:33 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:22:34.222668 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c1aeebb8-67b8-4648-a859-5c23409de05e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:34.223302 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-c1aeebb8-67b8-4648-a859-5c23409de05e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:34.230405 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c1aeebb8-67b8-4648-a859-5c23409de05e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:34.230851 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c1aeebb8-67b8-4648-a859-5c23409de05e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:34.231604 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c1aeebb8-67b8-4648-a859-5c23409de05e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:34.232036 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-c1aeebb8-67b8-4648-a859-5c23409de05e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:34.340280 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-61e464c0-f158-442d-a292-f380e9b5ba26 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:34.341013 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-61e464c0-f158-442d-a292-f380e9b5ba26 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:34.347813 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61e464c0-f158-442d-a292-f380e9b5ba26 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:34.348261 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61e464c0-f158-442d-a292-f380e9b5ba26 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:34.349033 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61e464c0-f158-442d-a292-f380e9b5ba26 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:34.349466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-61e464c0-f158-442d-a292-f380e9b5ba26 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:34.363571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c1aeebb8-67b8-4648-a859-5c23409de05e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:34.372135 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c1aeebb8-67b8-4648-a859-5c23409de05e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:34.373627 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-c1aeebb8-67b8-4648-a859-5c23409de05e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:34.374818 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c1aeebb8-67b8-4648-a859-5c23409de05e tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1724 microversion: 2.20 time: 0.156298 Jun 16 16:22:34.375382 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 521/1040] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:34 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:34.482977 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-61e464c0-f158-442d-a292-f380e9b5ba26 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:34.490356 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-61e464c0-f158-442d-a292-f380e9b5ba26 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 200 len: 1367 microversion: 2.1 time: 0.153968 Jun 16 16:22:34.490921 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 520/1041] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:22:34 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:22:35.393020 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e83bdeb6-a8c2-4a22-b25b-26fd5e22cf85 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:35.393552 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e83bdeb6-a8c2-4a22-b25b-26fd5e22cf85 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:35.400575 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e83bdeb6-a8c2-4a22-b25b-26fd5e22cf85 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:35.401023 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e83bdeb6-a8c2-4a22-b25b-26fd5e22cf85 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:35.401806 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e83bdeb6-a8c2-4a22-b25b-26fd5e22cf85 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:35.402245 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e83bdeb6-a8c2-4a22-b25b-26fd5e22cf85 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:35.507707 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-11ab7734-b0ef-441f-a377-de895c9510c1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:35.508938 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-11ab7734-b0ef-441f-a377-de895c9510c1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:35.515268 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-11ab7734-b0ef-441f-a377-de895c9510c1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:35.515719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-11ab7734-b0ef-441f-a377-de895c9510c1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:35.516489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-11ab7734-b0ef-441f-a377-de895c9510c1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:35.516930 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-11ab7734-b0ef-441f-a377-de895c9510c1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:35.528054 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e83bdeb6-a8c2-4a22-b25b-26fd5e22cf85 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:35.535946 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e83bdeb6-a8c2-4a22-b25b-26fd5e22cf85 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:35.537435 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e83bdeb6-a8c2-4a22-b25b-26fd5e22cf85 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:35.539207 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e83bdeb6-a8c2-4a22-b25b-26fd5e22cf85 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1724 microversion: 2.20 time: 0.149637 Jun 16 16:22:35.539757 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 522/1042] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:35 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:35.649163 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-11ab7734-b0ef-441f-a377-de895c9510c1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:35.656741 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-11ab7734-b0ef-441f-a377-de895c9510c1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 200 len: 1367 microversion: 2.1 time: 0.152913 Jun 16 16:22:35.657311 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 521/1043] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:22:35 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:22:36.559334 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1231a92d-df93-48c3-b50b-9117a4659bb4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:36.559941 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1231a92d-df93-48c3-b50b-9117a4659bb4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:36.566482 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1231a92d-df93-48c3-b50b-9117a4659bb4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:36.566947 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1231a92d-df93-48c3-b50b-9117a4659bb4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:36.567686 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1231a92d-df93-48c3-b50b-9117a4659bb4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:36.568119 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1231a92d-df93-48c3-b50b-9117a4659bb4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:36.672593 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3fa02660-ccc5-4da4-b4cc-150143cadd72 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:36.673144 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3fa02660-ccc5-4da4-b4cc-150143cadd72 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:36.680144 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3fa02660-ccc5-4da4-b4cc-150143cadd72 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:36.680587 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3fa02660-ccc5-4da4-b4cc-150143cadd72 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:36.681353 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3fa02660-ccc5-4da4-b4cc-150143cadd72 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:36.681802 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3fa02660-ccc5-4da4-b4cc-150143cadd72 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:36.696223 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1231a92d-df93-48c3-b50b-9117a4659bb4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:36.704351 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1231a92d-df93-48c3-b50b-9117a4659bb4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:36.705886 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1231a92d-df93-48c3-b50b-9117a4659bb4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:36.707222 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1231a92d-df93-48c3-b50b-9117a4659bb4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1724 microversion: 2.20 time: 0.151835 Jun 16 16:22:36.707778 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 523/1044] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:36 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:36.809653 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3fa02660-ccc5-4da4-b4cc-150143cadd72 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:36.817205 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3fa02660-ccc5-4da4-b4cc-150143cadd72 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 200 len: 1367 microversion: 2.1 time: 0.148550 Jun 16 16:22:36.817785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 522/1045] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:22:36 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:22:37.834727 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-14bca457-2864-410a-b80f-9a07039f4b3b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:37.835425 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-14bca457-2864-410a-b80f-9a07039f4b3b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:37.842111 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-14bca457-2864-410a-b80f-9a07039f4b3b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:37.842656 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-14bca457-2864-410a-b80f-9a07039f4b3b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:37.843496 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-14bca457-2864-410a-b80f-9a07039f4b3b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:37.844009 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-14bca457-2864-410a-b80f-9a07039f4b3b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:37.853923 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-01561bcc-f29c-48e5-98c6-89d384a20dfc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:37.854533 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-01561bcc-f29c-48e5-98c6-89d384a20dfc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:37.860737 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01561bcc-f29c-48e5-98c6-89d384a20dfc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:37.861180 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01561bcc-f29c-48e5-98c6-89d384a20dfc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:37.861968 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01561bcc-f29c-48e5-98c6-89d384a20dfc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:37.862575 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01561bcc-f29c-48e5-98c6-89d384a20dfc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:38.045616 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-14bca457-2864-410a-b80f-9a07039f4b3b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:38.050119 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:38.055117 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-14bca457-2864-410a-b80f-9a07039f4b3b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 200 len: 1367 microversion: 2.1 time: 0.224212 Jun 16 16:22:38.057810 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 523/1046] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:22:37 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:22:38.057951 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-01561bcc-f29c-48e5-98c6-89d384a20dfc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:38.068068 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-01561bcc-f29c-48e5-98c6-89d384a20dfc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:38.070091 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-01561bcc-f29c-48e5-98c6-89d384a20dfc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:38.071255 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-01561bcc-f29c-48e5-98c6-89d384a20dfc tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1745 microversion: 2.20 time: 0.349023 Jun 16 16:22:38.072117 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 524/1047] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:37 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1745 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:39.072561 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-076297e8-4629-46d1-8f01-d4f260856b5b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:39.073167 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-076297e8-4629-46d1-8f01-d4f260856b5b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:39.080948 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-076297e8-4629-46d1-8f01-d4f260856b5b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:39.081326 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-076297e8-4629-46d1-8f01-d4f260856b5b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:39.082140 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-076297e8-4629-46d1-8f01-d4f260856b5b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:39.082576 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-076297e8-4629-46d1-8f01-d4f260856b5b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:39.090081 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-354f616d-e38f-433d-b955-a650f150ab2c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:39.090723 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-354f616d-e38f-433d-b955-a650f150ab2c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:39.097480 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-354f616d-e38f-433d-b955-a650f150ab2c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:39.097965 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-354f616d-e38f-433d-b955-a650f150ab2c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:39.098728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-354f616d-e38f-433d-b955-a650f150ab2c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:39.099159 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-354f616d-e38f-433d-b955-a650f150ab2c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:39.282364 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-076297e8-4629-46d1-8f01-d4f260856b5b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:39.286403 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-354f616d-e38f-433d-b955-a650f150ab2c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:39.290758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-076297e8-4629-46d1-8f01-d4f260856b5b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 200 len: 1367 microversion: 2.1 time: 0.222828 Jun 16 16:22:39.291432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 524/1048] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:22:39 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:22:39.294906 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-354f616d-e38f-433d-b955-a650f150ab2c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:39.296398 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-354f616d-e38f-433d-b955-a650f150ab2c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:39.297544 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-354f616d-e38f-433d-b955-a650f150ab2c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1745 microversion: 2.20 time: 0.211358 Jun 16 16:22:39.298121 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 525/1049] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:39 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1745 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:22:40.134935 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-cfb0b249-6823-45d9-ad35-ac935f7297af req-6e2533ca-c876-4cd4-8f09-6ff3369fda08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a598febb-d1e1-4593-8547-bc0075f39338", "name": "network-vif-plugged", "status": "completed", "tag": "7d6dbef9-8302-4765-a850-0e7746870788"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:22:40.143030 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:40.143889 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=10 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:40.146686 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-cfb0b249-6823-45d9-ad35-ac935f7297af req-6e2533ca-c876-4cd4-8f09-6ff3369fda08 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:40.147229 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-cfb0b249-6823-45d9-ad35-ac935f7297af req-6e2533ca-c876-4cd4-8f09-6ff3369fda08 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:40.160116 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-cfb0b249-6823-45d9-ad35-ac935f7297af req-6e2533ca-c876-4cd4-8f09-6ff3369fda08 service nova] Creating event network-vif-plugged:7d6dbef9-8302-4765-a850-0e7746870788 for instance a598febb-d1e1-4593-8547-bc0075f39338 on hv-cinder-83735 Jun 16 16:22:40.164861 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-cfb0b249-6823-45d9-ad35-ac935f7297af req-6e2533ca-c876-4cd4-8f09-6ff3369fda08 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034768 Jun 16 16:22:40.165450 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 525/1050] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:22:40.307693 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-828262e3-6a70-42cf-b6c0-5c9b4b25ca1c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:40.308412 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-828262e3-6a70-42cf-b6c0-5c9b4b25ca1c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:40.316810 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d0fd372e-05fb-4aed-a2d6-d454c1f01e40 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:40.317513 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d0fd372e-05fb-4aed-a2d6-d454c1f01e40 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:40.325895 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:40.328495 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-828262e3-6a70-42cf-b6c0-5c9b4b25ca1c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:40.328945 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-828262e3-6a70-42cf-b6c0-5c9b4b25ca1c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:40.329737 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-828262e3-6a70-42cf-b6c0-5c9b4b25ca1c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:40.330179 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-828262e3-6a70-42cf-b6c0-5c9b4b25ca1c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:40.335437 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d0fd372e-05fb-4aed-a2d6-d454c1f01e40 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:40.335891 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d0fd372e-05fb-4aed-a2d6-d454c1f01e40 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:40.336669 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d0fd372e-05fb-4aed-a2d6-d454c1f01e40 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:40.337108 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d0fd372e-05fb-4aed-a2d6-d454c1f01e40 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:40.609528 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d0fd372e-05fb-4aed-a2d6-d454c1f01e40 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:40.613768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-828262e3-6a70-42cf-b6c0-5c9b4b25ca1c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:40.621700 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-828262e3-6a70-42cf-b6c0-5c9b4b25ca1c tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 200 len: 1367 microversion: 2.1 time: 0.318680 Jun 16 16:22:40.622287 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 526/1051] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:22:40 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:22:40.623312 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d0fd372e-05fb-4aed-a2d6-d454c1f01e40 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:40.626341 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d0fd372e-05fb-4aed-a2d6-d454c1f01e40 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:40.628568 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d0fd372e-05fb-4aed-a2d6-d454c1f01e40 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1745 microversion: 2.20 time: 0.316418 Jun 16 16:22:40.629571 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 526/1052] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:40 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1745 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:41.638135 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-cc6b0773-0380-47f1-a164-602da22854cf tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:41.638715 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-cc6b0773-0380-47f1-a164-602da22854cf tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:41.645876 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc6b0773-0380-47f1-a164-602da22854cf tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:41.646321 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc6b0773-0380-47f1-a164-602da22854cf tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:41.647136 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc6b0773-0380-47f1-a164-602da22854cf tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:41.647264 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d2171285-bbaf-4d92-9527-a1ab06c0083b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:41.647696 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-cc6b0773-0380-47f1-a164-602da22854cf tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:41.647846 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d2171285-bbaf-4d92-9527-a1ab06c0083b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:41.654377 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2171285-bbaf-4d92-9527-a1ab06c0083b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:41.654828 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2171285-bbaf-4d92-9527-a1ab06c0083b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:41.655596 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2171285-bbaf-4d92-9527-a1ab06c0083b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:41.656034 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d2171285-bbaf-4d92-9527-a1ab06c0083b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:41.841916 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d2171285-bbaf-4d92-9527-a1ab06c0083b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:41.845794 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-cc6b0773-0380-47f1-a164-602da22854cf tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:41.852188 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d2171285-bbaf-4d92-9527-a1ab06c0083b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:41.852926 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-cc6b0773-0380-47f1-a164-602da22854cf tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 200 len: 1367 microversion: 2.1 time: 0.218678 Jun 16 16:22:41.853638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 527/1053] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:22:41 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:22:41.854442 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d2171285-bbaf-4d92-9527-a1ab06c0083b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:41.855774 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d2171285-bbaf-4d92-9527-a1ab06c0083b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1745 microversion: 2.20 time: 0.212314 Jun 16 16:22:41.856466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 527/1054] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:41 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1745 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:22:42.183369 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-8176d99a-fe5f-4530-9b11-68168344b91b req-32edb18e-6610-45a1-a1c4-a8128fd92135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f151b6-bfce-4c42-932f-7be72f7da4b4", "name": "network-vif-plugged", "status": "completed", "tag": "44d3a737-8fd0-480a-b4eb-2bc5eb327a3f"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:22:42.191516 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-8176d99a-fe5f-4530-9b11-68168344b91b req-32edb18e-6610-45a1-a1c4-a8128fd92135 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:42.191962 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-8176d99a-fe5f-4530-9b11-68168344b91b req-32edb18e-6610-45a1-a1c4-a8128fd92135 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:42.202615 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-8176d99a-fe5f-4530-9b11-68168344b91b req-32edb18e-6610-45a1-a1c4-a8128fd92135 service nova] Creating event network-vif-plugged:44d3a737-8fd0-480a-b4eb-2bc5eb327a3f for instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 on hv-cinder-83735 Jun 16 16:22:42.207503 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-8176d99a-fe5f-4530-9b11-68168344b91b req-32edb18e-6610-45a1-a1c4-a8128fd92135 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028498 Jun 16 16:22:42.208067 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 528/1055] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:22:42.870251 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3ed3aca8-6b40-4d5f-9eb0-4169d9a75767 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:42.870865 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3ed3aca8-6b40-4d5f-9eb0-4169d9a75767 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:42.874359 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4bb7611a-928f-41bb-b11a-c381d0ee078c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:42.875061 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4bb7611a-928f-41bb-b11a-c381d0ee078c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:42.876934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:42.877381 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3ed3aca8-6b40-4d5f-9eb0-4169d9a75767 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:42.877894 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3ed3aca8-6b40-4d5f-9eb0-4169d9a75767 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:42.878782 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3ed3aca8-6b40-4d5f-9eb0-4169d9a75767 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:42.879260 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3ed3aca8-6b40-4d5f-9eb0-4169d9a75767 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:42.883453 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4bb7611a-928f-41bb-b11a-c381d0ee078c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:42.883904 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4bb7611a-928f-41bb-b11a-c381d0ee078c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:42.884657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4bb7611a-928f-41bb-b11a-c381d0ee078c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:42.885261 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4bb7611a-928f-41bb-b11a-c381d0ee078c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:43.084514 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3ed3aca8-6b40-4d5f-9eb0-4169d9a75767 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:43.088310 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4bb7611a-928f-41bb-b11a-c381d0ee078c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:43.092075 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3ed3aca8-6b40-4d5f-9eb0-4169d9a75767 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 200 len: 1367 microversion: 2.1 time: 0.226224 Jun 16 16:22:43.092684 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 528/1056] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:22:42 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:22:43.096573 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4bb7611a-928f-41bb-b11a-c381d0ee078c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:43.098359 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4bb7611a-928f-41bb-b11a-c381d0ee078c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:43.099522 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4bb7611a-928f-41bb-b11a-c381d0ee078c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1745 microversion: 2.20 time: 0.229766 Jun 16 16:22:43.100060 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 529/1057] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:42 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1745 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:22:44.109518 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c7d4dc48-58ac-405c-8de8-029edbd40f65 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:44.110168 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c7d4dc48-58ac-405c-8de8-029edbd40f65 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:44.117246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c7d4dc48-58ac-405c-8de8-029edbd40f65 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:44.117688 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c7d4dc48-58ac-405c-8de8-029edbd40f65 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:44.118174 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-01c29e9f-844c-41dd-990f-7192b4dbbd97 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:44.118593 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c7d4dc48-58ac-405c-8de8-029edbd40f65 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:44.118782 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-01c29e9f-844c-41dd-990f-7192b4dbbd97 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:44.118929 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c7d4dc48-58ac-405c-8de8-029edbd40f65 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:44.125385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01c29e9f-844c-41dd-990f-7192b4dbbd97 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:44.125854 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01c29e9f-844c-41dd-990f-7192b4dbbd97 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:44.126650 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01c29e9f-844c-41dd-990f-7192b4dbbd97 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:44.127080 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-01c29e9f-844c-41dd-990f-7192b4dbbd97 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:44.310847 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c7d4dc48-58ac-405c-8de8-029edbd40f65 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:44.317893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-01c29e9f-844c-41dd-990f-7192b4dbbd97 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:44.318498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c7d4dc48-58ac-405c-8de8-029edbd40f65 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 200 len: 1557 microversion: 2.1 time: 0.212708 Jun 16 16:22:44.319083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 529/1058] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:22:44 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 1557 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:22:44.326706 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-01c29e9f-844c-41dd-990f-7192b4dbbd97 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:44.328197 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-01c29e9f-844c-41dd-990f-7192b4dbbd97 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:44.329434 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-01c29e9f-844c-41dd-990f-7192b4dbbd97 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1745 microversion: 2.20 time: 0.215630 Jun 16 16:22:44.330101 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 530/1059] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:44 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1745 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:22:44.400830 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-18a31a29-77e1-489f-abc7-189d4693f15a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:44.401540 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-18a31a29-77e1-489f-abc7-189d4693f15a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:44.409710 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-18a31a29-77e1-489f-abc7-189d4693f15a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:44.410232 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-18a31a29-77e1-489f-abc7-189d4693f15a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:44.411133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-18a31a29-77e1-489f-abc7-189d4693f15a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:44.411563 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-18a31a29-77e1-489f-abc7-189d4693f15a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:44.496489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-18a31a29-77e1-489f-abc7-189d4693f15a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.165681 Jun 16 16:22:44.497177 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 530/1060] 10.222.0.88 () {58 vars in 1274 bytes} [Thu Jun 16 16:22:44 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:22:45.349223 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e370c9ec-b66c-4ce6-8dd3-880fb030abe3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:45.349877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e370c9ec-b66c-4ce6-8dd3-880fb030abe3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:45.358090 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e370c9ec-b66c-4ce6-8dd3-880fb030abe3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:45.358546 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e370c9ec-b66c-4ce6-8dd3-880fb030abe3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:45.359319 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e370c9ec-b66c-4ce6-8dd3-880fb030abe3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:45.359756 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e370c9ec-b66c-4ce6-8dd3-880fb030abe3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:45.398717 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:22:45.399098 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Thu Jun 16 16:22:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 (ip 10.222.0.88) !!! Jun 16 16:22:45.505913 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-d0257ae7-95e0-4ccb-acc3-25189d28af54 req-cbafc704-316a-485c-9097-f17f390bce5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a598febb-d1e1-4593-8547-bc0075f39338", "tag": "7d6dbef9-8302-4765-a850-0e7746870788"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:22:45.521496 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-d0257ae7-95e0-4ccb-acc3-25189d28af54 req-cbafc704-316a-485c-9097-f17f390bce5f service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:45.526807 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-d0257ae7-95e0-4ccb-acc3-25189d28af54 req-cbafc704-316a-485c-9097-f17f390bce5f service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:45.530012 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e370c9ec-b66c-4ce6-8dd3-880fb030abe3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:45.541930 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e370c9ec-b66c-4ce6-8dd3-880fb030abe3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:45.543924 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e370c9ec-b66c-4ce6-8dd3-880fb030abe3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:45.545279 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e370c9ec-b66c-4ce6-8dd3-880fb030abe3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1740 microversion: 2.20 time: 0.200233 Jun 16 16:22:45.546409 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 531/1061] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:45 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:45.550574 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-d0257ae7-95e0-4ccb-acc3-25189d28af54 req-cbafc704-316a-485c-9097-f17f390bce5f service nova] Creating event network-changed:7d6dbef9-8302-4765-a850-0e7746870788 for instance a598febb-d1e1-4593-8547-bc0075f39338 on hv-cinder-83735 Jun 16 16:22:45.559777 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-d0257ae7-95e0-4ccb-acc3-25189d28af54 req-cbafc704-316a-485c-9097-f17f390bce5f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057534 Jun 16 16:22:45.560889 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 531/1062] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:22:46.564988 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-101dac43-a82a-4f5b-b75b-8bf790890371 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:46.565861 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-101dac43-a82a-4f5b-b75b-8bf790890371 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:46.578774 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-101dac43-a82a-4f5b-b75b-8bf790890371 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:46.579571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-101dac43-a82a-4f5b-b75b-8bf790890371 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:46.580696 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-101dac43-a82a-4f5b-b75b-8bf790890371 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:46.581338 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-101dac43-a82a-4f5b-b75b-8bf790890371 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:46.781124 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-101dac43-a82a-4f5b-b75b-8bf790890371 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:46.790314 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-101dac43-a82a-4f5b-b75b-8bf790890371 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:46.794561 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-101dac43-a82a-4f5b-b75b-8bf790890371 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:46.796038 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-101dac43-a82a-4f5b-b75b-8bf790890371 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1740 microversion: 2.20 time: 0.236107 Jun 16 16:22:46.796820 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 532/1063] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:46 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:47.817532 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b3a3bcaa-97c1-4bdf-8900-f7adc115d235 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:47.818948 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b3a3bcaa-97c1-4bdf-8900-f7adc115d235 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:47.825984 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b3a3bcaa-97c1-4bdf-8900-f7adc115d235 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:47.826755 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b3a3bcaa-97c1-4bdf-8900-f7adc115d235 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:47.827774 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b3a3bcaa-97c1-4bdf-8900-f7adc115d235 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:47.828432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b3a3bcaa-97c1-4bdf-8900-f7adc115d235 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:47.971570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b3a3bcaa-97c1-4bdf-8900-f7adc115d235 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:47.980525 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b3a3bcaa-97c1-4bdf-8900-f7adc115d235 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:47.982097 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b3a3bcaa-97c1-4bdf-8900-f7adc115d235 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:47.983245 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b3a3bcaa-97c1-4bdf-8900-f7adc115d235 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1740 microversion: 2.20 time: 0.170536 Jun 16 16:22:47.984311 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 532/1064] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:47 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:49.003876 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4bb52f85-dea3-43bc-ba76-80bd47b22b55 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:49.004664 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4bb52f85-dea3-43bc-ba76-80bd47b22b55 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:49.013302 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4bb52f85-dea3-43bc-ba76-80bd47b22b55 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:49.013773 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4bb52f85-dea3-43bc-ba76-80bd47b22b55 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:49.014583 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4bb52f85-dea3-43bc-ba76-80bd47b22b55 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:49.015033 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4bb52f85-dea3-43bc-ba76-80bd47b22b55 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:49.163647 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4bb52f85-dea3-43bc-ba76-80bd47b22b55 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:49.173252 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4bb52f85-dea3-43bc-ba76-80bd47b22b55 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:49.174898 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4bb52f85-dea3-43bc-ba76-80bd47b22b55 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:49.176508 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4bb52f85-dea3-43bc-ba76-80bd47b22b55 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1740 microversion: 2.20 time: 0.177969 Jun 16 16:22:49.177268 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 533/1065] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:48 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:50.198288 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6216143b-dc86-497c-8c05-2f804525fae8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:50.198914 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6216143b-dc86-497c-8c05-2f804525fae8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:50.206925 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6216143b-dc86-497c-8c05-2f804525fae8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:50.207630 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6216143b-dc86-497c-8c05-2f804525fae8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:50.208407 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6216143b-dc86-497c-8c05-2f804525fae8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:50.209021 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6216143b-dc86-497c-8c05-2f804525fae8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:50.361514 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6216143b-dc86-497c-8c05-2f804525fae8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:50.370523 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6216143b-dc86-497c-8c05-2f804525fae8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:50.372029 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6216143b-dc86-497c-8c05-2f804525fae8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:50.373200 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6216143b-dc86-497c-8c05-2f804525fae8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1740 microversion: 2.20 time: 0.179146 Jun 16 16:22:50.373767 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 533/1066] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:50 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:51.392112 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5e8cdafb-96f7-45e5-980c-b6634e6d9890 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:51.392678 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5e8cdafb-96f7-45e5-980c-b6634e6d9890 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:51.399878 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5e8cdafb-96f7-45e5-980c-b6634e6d9890 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:51.400339 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5e8cdafb-96f7-45e5-980c-b6634e6d9890 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:51.401144 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5e8cdafb-96f7-45e5-980c-b6634e6d9890 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:51.401591 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5e8cdafb-96f7-45e5-980c-b6634e6d9890 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:51.556633 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5e8cdafb-96f7-45e5-980c-b6634e6d9890 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:51.565158 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5e8cdafb-96f7-45e5-980c-b6634e6d9890 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:51.566694 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5e8cdafb-96f7-45e5-980c-b6634e6d9890 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:51.568019 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5e8cdafb-96f7-45e5-980c-b6634e6d9890 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1740 microversion: 2.20 time: 0.180156 Jun 16 16:22:51.578756 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 534/1067] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:51 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:52.587052 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-323da994-abfe-41f3-aee9-483f1b07276b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:52.587657 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-323da994-abfe-41f3-aee9-483f1b07276b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:52.591358 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:52.595227 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-323da994-abfe-41f3-aee9-483f1b07276b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:52.595883 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-323da994-abfe-41f3-aee9-483f1b07276b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:52.596647 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-323da994-abfe-41f3-aee9-483f1b07276b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:52.597079 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-323da994-abfe-41f3-aee9-483f1b07276b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:52.748813 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-323da994-abfe-41f3-aee9-483f1b07276b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:52.758506 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-323da994-abfe-41f3-aee9-483f1b07276b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:52.760008 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-323da994-abfe-41f3-aee9-483f1b07276b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:52.761181 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-323da994-abfe-41f3-aee9-483f1b07276b tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1740 microversion: 2.20 time: 0.178604 Jun 16 16:22:52.761939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 534/1068] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:52 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:53.780377 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-533f9b40-1731-4396-9dcd-09924a2c017f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:53.780964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-533f9b40-1731-4396-9dcd-09924a2c017f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:53.788408 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-533f9b40-1731-4396-9dcd-09924a2c017f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:53.789124 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-533f9b40-1731-4396-9dcd-09924a2c017f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:53.790090 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-533f9b40-1731-4396-9dcd-09924a2c017f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:53.790772 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-533f9b40-1731-4396-9dcd-09924a2c017f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:53.930681 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-533f9b40-1731-4396-9dcd-09924a2c017f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:53.941366 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-533f9b40-1731-4396-9dcd-09924a2c017f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:53.943021 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-533f9b40-1731-4396-9dcd-09924a2c017f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:53.944728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-533f9b40-1731-4396-9dcd-09924a2c017f tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1740 microversion: 2.20 time: 0.167729 Jun 16 16:22:53.945457 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 535/1069] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:53 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:54.963140 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-33cb1d7f-9cfc-45f6-9adc-4054b29836d5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:54.963725 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-33cb1d7f-9cfc-45f6-9adc-4054b29836d5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:54.971401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-33cb1d7f-9cfc-45f6-9adc-4054b29836d5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:54.971849 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-33cb1d7f-9cfc-45f6-9adc-4054b29836d5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:54.972858 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-33cb1d7f-9cfc-45f6-9adc-4054b29836d5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:54.973287 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-33cb1d7f-9cfc-45f6-9adc-4054b29836d5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:55.104287 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-33cb1d7f-9cfc-45f6-9adc-4054b29836d5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:55.112325 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-33cb1d7f-9cfc-45f6-9adc-4054b29836d5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:55.113852 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-33cb1d7f-9cfc-45f6-9adc-4054b29836d5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:55.115004 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-33cb1d7f-9cfc-45f6-9adc-4054b29836d5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1740 microversion: 2.20 time: 0.155956 Jun 16 16:22:55.115560 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 535/1070] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:54 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:56.135982 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-43a75e87-61a9-4983-9587-d4f773c0f707 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:56.137532 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-43a75e87-61a9-4983-9587-d4f773c0f707 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:56.145234 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-43a75e87-61a9-4983-9587-d4f773c0f707 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:56.145693 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-43a75e87-61a9-4983-9587-d4f773c0f707 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:56.146512 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-43a75e87-61a9-4983-9587-d4f773c0f707 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:56.146994 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-43a75e87-61a9-4983-9587-d4f773c0f707 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:56.352804 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-43a75e87-61a9-4983-9587-d4f773c0f707 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:56.360975 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-43a75e87-61a9-4983-9587-d4f773c0f707 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:56.362516 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-43a75e87-61a9-4983-9587-d4f773c0f707 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:56.363675 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-43a75e87-61a9-4983-9587-d4f773c0f707 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1722 microversion: 2.20 time: 0.234065 Jun 16 16:22:56.364237 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 536/1071] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:56 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:57.382680 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ad8cd8f8-0799-48ea-b47b-c9835688d632 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:57.383286 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ad8cd8f8-0799-48ea-b47b-c9835688d632 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:57.389770 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ad8cd8f8-0799-48ea-b47b-c9835688d632 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:57.390215 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ad8cd8f8-0799-48ea-b47b-c9835688d632 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:57.391015 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ad8cd8f8-0799-48ea-b47b-c9835688d632 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:57.391397 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ad8cd8f8-0799-48ea-b47b-c9835688d632 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:57.517408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ad8cd8f8-0799-48ea-b47b-c9835688d632 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:57.526294 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ad8cd8f8-0799-48ea-b47b-c9835688d632 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:57.528100 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ad8cd8f8-0799-48ea-b47b-c9835688d632 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:57.529242 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ad8cd8f8-0799-48ea-b47b-c9835688d632 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1722 microversion: 2.20 time: 0.150532 Jun 16 16:22:57.529906 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 536/1072] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:57 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:58.548198 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-d252750d-160e-41bf-b897-0e7dfc93909a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:58.548801 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-d252750d-160e-41bf-b897-0e7dfc93909a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:58.555233 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d252750d-160e-41bf-b897-0e7dfc93909a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:58.555673 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d252750d-160e-41bf-b897-0e7dfc93909a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:58.556427 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d252750d-160e-41bf-b897-0e7dfc93909a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:58.556857 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-d252750d-160e-41bf-b897-0e7dfc93909a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:58.574378 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=100 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:58.687751 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d252750d-160e-41bf-b897-0e7dfc93909a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:58.695581 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d252750d-160e-41bf-b897-0e7dfc93909a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:58.697078 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-d252750d-160e-41bf-b897-0e7dfc93909a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:58.698265 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-d252750d-160e-41bf-b897-0e7dfc93909a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1722 microversion: 2.20 time: 0.153991 Jun 16 16:22:58.698827 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 537/1073] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:58 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:59.716407 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-556c97b8-c33c-4c55-8fb1-8f6ef22468da tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:22:59.717015 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-556c97b8-c33c-4c55-8fb1-8f6ef22468da tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:59.723480 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-556c97b8-c33c-4c55-8fb1-8f6ef22468da tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:59.723929 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-556c97b8-c33c-4c55-8fb1-8f6ef22468da tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:59.724688 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-556c97b8-c33c-4c55-8fb1-8f6ef22468da tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:59.725122 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-556c97b8-c33c-4c55-8fb1-8f6ef22468da tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:59.851239 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-556c97b8-c33c-4c55-8fb1-8f6ef22468da tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:59.859307 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-556c97b8-c33c-4c55-8fb1-8f6ef22468da tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:59.860784 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-556c97b8-c33c-4c55-8fb1-8f6ef22468da tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:22:59.861960 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-556c97b8-c33c-4c55-8fb1-8f6ef22468da tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1665 microversion: 2.20 time: 0.149433 Jun 16 16:22:59.862537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 537/1074] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:22:59 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1665 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:22:59.879255 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a4920aa1-2bc1-4729-ac48-b641801ff321 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fff0b23f-ff9d-4568-9dbd-aed5799b9766"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:22:59.880334 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a4920aa1-2bc1-4729-ac48-b641801ff321 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:22:59.887262 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a4920aa1-2bc1-4729-ac48-b641801ff321 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:59.887711 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a4920aa1-2bc1-4729-ac48-b641801ff321 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:22:59.888460 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a4920aa1-2bc1-4729-ac48-b641801ff321 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:22:59.888895 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a4920aa1-2bc1-4729-ac48-b641801ff321 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:00.146429 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-39524eee-802a-4050-9022-68baea9b9929 req-194baf4e-9de9-4c96-8b39-6fe39685bae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f151b6-bfce-4c42-932f-7be72f7da4b4", "name": "network-vif-unplugged", "status": "completed", "tag": "44d3a737-8fd0-480a-b4eb-2bc5eb327a3f"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:23:00.156137 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-39524eee-802a-4050-9022-68baea9b9929 req-194baf4e-9de9-4c96-8b39-6fe39685bae0 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:00.156611 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-39524eee-802a-4050-9022-68baea9b9929 req-194baf4e-9de9-4c96-8b39-6fe39685bae0 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:00.168872 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.compute.server_external_events [req-39524eee-802a-4050-9022-68baea9b9929 req-194baf4e-9de9-4c96-8b39-6fe39685bae0 service nova] Unable to find a host for instance 38f151b6-bfce-4c42-932f-7be72f7da4b4. Dropping event network-vif-unplugged {{(pid=117712) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 16:23:00.169837 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-39524eee-802a-4050-9022-68baea9b9929 req-194baf4e-9de9-4c96-8b39-6fe39685bae0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032674 Jun 16 16:23:00.170836 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 538/1075] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 16:23:00.172553 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a4920aa1-2bc1-4729-ac48-b641801ff321 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "POST /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.296966 Jun 16 16:23:00.173172 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 538/1076] 10.222.0.88 () {62 vars in 1363 bytes} [Thu Jun 16 16:22:59 2022] POST /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4/os-volume_attachments => generated 188 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:23:00.284695 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fd768834-498b-4d1e-a08c-54e0ceeda039 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:00.285191 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fd768834-498b-4d1e-a08c-54e0ceeda039 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:00.291927 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fd768834-498b-4d1e-a08c-54e0ceeda039 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:00.292373 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fd768834-498b-4d1e-a08c-54e0ceeda039 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:00.293133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fd768834-498b-4d1e-a08c-54e0ceeda039 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:00.293570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fd768834-498b-4d1e-a08c-54e0ceeda039 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:00.540991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fd768834-498b-4d1e-a08c-54e0ceeda039 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "DELETE /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4/os-volume_attachments/fff0b23f-ff9d-4568-9dbd-aed5799b9766" status: 202 len: 0 microversion: 2.20 time: 0.260127 Jun 16 16:23:00.541589 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 539/1077] 10.222.0.88 () {60 vars in 1456 bytes} [Thu Jun 16 16:23:00 2022] DELETE /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4/os-volume_attachments/fff0b23f-ff9d-4568-9dbd-aed5799b9766 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:23:00.597373 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4c873224-1278-4aaf-8ceb-3c7e47f8edcb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:23:00.597980 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4c873224-1278-4aaf-8ceb-3c7e47f8edcb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:00.604004 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4c873224-1278-4aaf-8ceb-3c7e47f8edcb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:00.604444 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4c873224-1278-4aaf-8ceb-3c7e47f8edcb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:00.605188 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4c873224-1278-4aaf-8ceb-3c7e47f8edcb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:00.605617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4c873224-1278-4aaf-8ceb-3c7e47f8edcb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:00.694931 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4c873224-1278-4aaf-8ceb-3c7e47f8edcb tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "POST /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4/action" status: 202 len: 0 microversion: 2.20 time: 0.101841 Jun 16 16:23:00.696214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 539/1078] 10.222.0.88 () {62 vars in 1318 bytes} [Thu Jun 16 16:23:00 2022] POST /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:23:00.703578 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-dd8deb41-4182-437f-be06-b3bbc13d7aed tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:00.704423 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dd8deb41-4182-437f-be06-b3bbc13d7aed tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:00.711418 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dd8deb41-4182-437f-be06-b3bbc13d7aed tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:00.711874 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dd8deb41-4182-437f-be06-b3bbc13d7aed tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:00.712648 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dd8deb41-4182-437f-be06-b3bbc13d7aed tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:00.713085 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dd8deb41-4182-437f-be06-b3bbc13d7aed tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:00.732520 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:00.853353 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dd8deb41-4182-437f-be06-b3bbc13d7aed tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:00.862643 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dd8deb41-4182-437f-be06-b3bbc13d7aed tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:00.864144 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dd8deb41-4182-437f-be06-b3bbc13d7aed tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:00.865321 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-dd8deb41-4182-437f-be06-b3bbc13d7aed tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1673 microversion: 2.20 time: 0.165630 Jun 16 16:23:00.866429 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 540/1079] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:00 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:01.885131 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-128b4e38-91a5-457b-befd-1f3464ace0b7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:01.885769 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-128b4e38-91a5-457b-befd-1f3464ace0b7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:01.891721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-128b4e38-91a5-457b-befd-1f3464ace0b7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:01.892171 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-128b4e38-91a5-457b-befd-1f3464ace0b7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:01.892935 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-128b4e38-91a5-457b-befd-1f3464ace0b7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:01.893377 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-128b4e38-91a5-457b-befd-1f3464ace0b7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:02.073110 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-128b4e38-91a5-457b-befd-1f3464ace0b7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:02.081185 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-128b4e38-91a5-457b-befd-1f3464ace0b7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:02.082726 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-128b4e38-91a5-457b-befd-1f3464ace0b7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:02.083902 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-128b4e38-91a5-457b-befd-1f3464ace0b7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1731 microversion: 2.20 time: 0.203409 Jun 16 16:23:02.084460 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 540/1080] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:01 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:03.104139 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fa303652-1ef8-48f1-bfd8-3a5a46ebffff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:03.105002 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fa303652-1ef8-48f1-bfd8-3a5a46ebffff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:03.112128 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fa303652-1ef8-48f1-bfd8-3a5a46ebffff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:03.112577 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fa303652-1ef8-48f1-bfd8-3a5a46ebffff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:03.113687 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fa303652-1ef8-48f1-bfd8-3a5a46ebffff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:03.114254 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fa303652-1ef8-48f1-bfd8-3a5a46ebffff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:03.258974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-fa303652-1ef8-48f1-bfd8-3a5a46ebffff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:03.268245 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-fa303652-1ef8-48f1-bfd8-3a5a46ebffff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:03.269952 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-fa303652-1ef8-48f1-bfd8-3a5a46ebffff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:03.271181 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fa303652-1ef8-48f1-bfd8-3a5a46ebffff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1731 microversion: 2.20 time: 0.171097 Jun 16 16:23:03.271839 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 541/1081] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:03 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:04.289427 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b733930e-e36d-4a3f-be6d-d0b0148c7f3a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:04.290090 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b733930e-e36d-4a3f-be6d-d0b0148c7f3a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:04.297068 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b733930e-e36d-4a3f-be6d-d0b0148c7f3a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:04.297633 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b733930e-e36d-4a3f-be6d-d0b0148c7f3a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:04.298566 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b733930e-e36d-4a3f-be6d-d0b0148c7f3a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:04.299104 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b733930e-e36d-4a3f-be6d-d0b0148c7f3a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:04.437617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b733930e-e36d-4a3f-be6d-d0b0148c7f3a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:04.446873 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b733930e-e36d-4a3f-be6d-d0b0148c7f3a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:04.448378 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b733930e-e36d-4a3f-be6d-d0b0148c7f3a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:04.449571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b733930e-e36d-4a3f-be6d-d0b0148c7f3a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1731 microversion: 2.20 time: 0.164654 Jun 16 16:23:04.460113 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 541/1082] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:04 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:05.467667 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f3b098ec-ea68-4116-9a46-c14e6eb8c368 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:05.468214 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f3b098ec-ea68-4116-9a46-c14e6eb8c368 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:05.474992 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f3b098ec-ea68-4116-9a46-c14e6eb8c368 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:05.476133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f3b098ec-ea68-4116-9a46-c14e6eb8c368 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:05.476918 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f3b098ec-ea68-4116-9a46-c14e6eb8c368 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:05.477359 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f3b098ec-ea68-4116-9a46-c14e6eb8c368 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:05.611539 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f3b098ec-ea68-4116-9a46-c14e6eb8c368 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:05.620005 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f3b098ec-ea68-4116-9a46-c14e6eb8c368 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:05.621493 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f3b098ec-ea68-4116-9a46-c14e6eb8c368 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:05.622675 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f3b098ec-ea68-4116-9a46-c14e6eb8c368 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1731 microversion: 2.20 time: 0.158997 Jun 16 16:23:05.623226 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 542/1083] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:05 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:06.640680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6091c937-86ce-47f2-a473-f666d7522240 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:06.641366 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6091c937-86ce-47f2-a473-f666d7522240 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:06.650213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6091c937-86ce-47f2-a473-f666d7522240 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:06.650851 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6091c937-86ce-47f2-a473-f666d7522240 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:06.651638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6091c937-86ce-47f2-a473-f666d7522240 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:06.652490 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6091c937-86ce-47f2-a473-f666d7522240 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:06.789019 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6091c937-86ce-47f2-a473-f666d7522240 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:06.798457 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6091c937-86ce-47f2-a473-f666d7522240 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:06.799981 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6091c937-86ce-47f2-a473-f666d7522240 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:06.801110 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6091c937-86ce-47f2-a473-f666d7522240 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1731 microversion: 2.20 time: 0.164467 Jun 16 16:23:06.801766 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 542/1084] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:06 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:23:07.822249 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-dbb9d96d-d813-49ec-ae12-c9bf74e76b4a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:07.822979 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dbb9d96d-d813-49ec-ae12-c9bf74e76b4a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:07.830065 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dbb9d96d-d813-49ec-ae12-c9bf74e76b4a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:07.830509 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dbb9d96d-d813-49ec-ae12-c9bf74e76b4a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:07.831277 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dbb9d96d-d813-49ec-ae12-c9bf74e76b4a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:07.831709 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dbb9d96d-d813-49ec-ae12-c9bf74e76b4a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:07.965505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dbb9d96d-d813-49ec-ae12-c9bf74e76b4a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:07.974273 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dbb9d96d-d813-49ec-ae12-c9bf74e76b4a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:07.975798 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dbb9d96d-d813-49ec-ae12-c9bf74e76b4a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:07.976985 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-dbb9d96d-d813-49ec-ae12-c9bf74e76b4a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1731 microversion: 2.20 time: 0.161033 Jun 16 16:23:07.977544 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 543/1085] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:07 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:08.996159 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-62026050-120f-4f9c-aa40-498f438a67f3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:08.996772 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-62026050-120f-4f9c-aa40-498f438a67f3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:09.004061 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-62026050-120f-4f9c-aa40-498f438a67f3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:09.004533 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-62026050-120f-4f9c-aa40-498f438a67f3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:09.005289 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-62026050-120f-4f9c-aa40-498f438a67f3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:09.005800 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-62026050-120f-4f9c-aa40-498f438a67f3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:09.152322 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-62026050-120f-4f9c-aa40-498f438a67f3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:09.161521 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-62026050-120f-4f9c-aa40-498f438a67f3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:09.163124 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-62026050-120f-4f9c-aa40-498f438a67f3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:09.164301 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-62026050-120f-4f9c-aa40-498f438a67f3 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1731 microversion: 2.20 time: 0.172760 Jun 16 16:23:09.165227 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 543/1086] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:08 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:23:10.183096 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-f11e95d2-5072-4e75-8bb9-0bc7516845aa tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:10.183709 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-f11e95d2-5072-4e75-8bb9-0bc7516845aa tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:10.190339 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f11e95d2-5072-4e75-8bb9-0bc7516845aa tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:10.190791 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f11e95d2-5072-4e75-8bb9-0bc7516845aa tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:10.191552 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f11e95d2-5072-4e75-8bb9-0bc7516845aa tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:10.191991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-f11e95d2-5072-4e75-8bb9-0bc7516845aa tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:10.328321 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f11e95d2-5072-4e75-8bb9-0bc7516845aa tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:10.337219 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f11e95d2-5072-4e75-8bb9-0bc7516845aa tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:10.338778 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-f11e95d2-5072-4e75-8bb9-0bc7516845aa tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:10.340002 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-f11e95d2-5072-4e75-8bb9-0bc7516845aa tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1731 microversion: 2.20 time: 0.160900 Jun 16 16:23:10.340654 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 544/1087] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:10 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:11.360287 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0e06e0f3-8df5-46ea-a0f2-ce42b44087c7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:11.360985 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0e06e0f3-8df5-46ea-a0f2-ce42b44087c7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:11.368281 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0e06e0f3-8df5-46ea-a0f2-ce42b44087c7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:11.368730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0e06e0f3-8df5-46ea-a0f2-ce42b44087c7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:11.369550 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0e06e0f3-8df5-46ea-a0f2-ce42b44087c7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:11.370015 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0e06e0f3-8df5-46ea-a0f2-ce42b44087c7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:11.507776 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0e06e0f3-8df5-46ea-a0f2-ce42b44087c7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:11.516721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0e06e0f3-8df5-46ea-a0f2-ce42b44087c7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:11.518654 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0e06e0f3-8df5-46ea-a0f2-ce42b44087c7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:11.519839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0e06e0f3-8df5-46ea-a0f2-ce42b44087c7 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1731 microversion: 2.20 time: 0.164359 Jun 16 16:23:11.520401 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 544/1088] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:11 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:12.539289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a31dcc04-b232-4f5a-a75d-799614a3f48d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:12.539936 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a31dcc04-b232-4f5a-a75d-799614a3f48d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:12.546526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a31dcc04-b232-4f5a-a75d-799614a3f48d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:12.546977 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a31dcc04-b232-4f5a-a75d-799614a3f48d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:12.547751 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a31dcc04-b232-4f5a-a75d-799614a3f48d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:12.548195 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a31dcc04-b232-4f5a-a75d-799614a3f48d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:12.691077 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a31dcc04-b232-4f5a-a75d-799614a3f48d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:12.700714 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a31dcc04-b232-4f5a-a75d-799614a3f48d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:12.702247 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a31dcc04-b232-4f5a-a75d-799614a3f48d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:12.703416 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a31dcc04-b232-4f5a-a75d-799614a3f48d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1731 microversion: 2.20 time: 0.168643 Jun 16 16:23:12.704183 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 545/1089] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:12 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:13.722394 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4f2ccd92-e442-4eda-8090-98535c92d0ff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:13.722996 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4f2ccd92-e442-4eda-8090-98535c92d0ff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:13.726279 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=34 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:13.732058 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4f2ccd92-e442-4eda-8090-98535c92d0ff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:13.732509 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4f2ccd92-e442-4eda-8090-98535c92d0ff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:13.733279 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4f2ccd92-e442-4eda-8090-98535c92d0ff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:13.733710 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4f2ccd92-e442-4eda-8090-98535c92d0ff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:13.865202 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4f2ccd92-e442-4eda-8090-98535c92d0ff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:13.873079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4f2ccd92-e442-4eda-8090-98535c92d0ff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:13.874618 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4f2ccd92-e442-4eda-8090-98535c92d0ff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:13.875893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4f2ccd92-e442-4eda-8090-98535c92d0ff tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1731 microversion: 2.20 time: 0.157727 Jun 16 16:23:13.876314 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 545/1090] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:13 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:14.894776 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-340f286a-0f28-4fdb-bbab-39166ecdf25a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:14.895389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-340f286a-0f28-4fdb-bbab-39166ecdf25a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:14.902031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-340f286a-0f28-4fdb-bbab-39166ecdf25a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:14.902486 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-340f286a-0f28-4fdb-bbab-39166ecdf25a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:14.903250 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-340f286a-0f28-4fdb-bbab-39166ecdf25a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:14.903690 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-340f286a-0f28-4fdb-bbab-39166ecdf25a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:15.031166 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-340f286a-0f28-4fdb-bbab-39166ecdf25a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:15.039682 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-340f286a-0f28-4fdb-bbab-39166ecdf25a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:15.041221 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-340f286a-0f28-4fdb-bbab-39166ecdf25a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:15.042402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-340f286a-0f28-4fdb-bbab-39166ecdf25a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1731 microversion: 2.20 time: 0.151594 Jun 16 16:23:15.042974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 546/1091] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:14 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:16.061313 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-28a4e68e-93ce-413c-9611-b3630788429c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:16.061944 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-28a4e68e-93ce-413c-9611-b3630788429c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:16.069082 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-28a4e68e-93ce-413c-9611-b3630788429c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:16.069521 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-28a4e68e-93ce-413c-9611-b3630788429c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:16.070302 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-28a4e68e-93ce-413c-9611-b3630788429c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:16.070734 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-28a4e68e-93ce-413c-9611-b3630788429c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:16.203868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-28a4e68e-93ce-413c-9611-b3630788429c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:16.211574 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-28a4e68e-93ce-413c-9611-b3630788429c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:16.213052 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-28a4e68e-93ce-413c-9611-b3630788429c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:16.214220 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-28a4e68e-93ce-413c-9611-b3630788429c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1731 microversion: 2.20 time: 0.156924 Jun 16 16:23:16.214768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 546/1092] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:16 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:17.232694 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8f239a40-1ee2-4f40-bdc1-3ef880548cf5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:17.233299 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8f239a40-1ee2-4f40-bdc1-3ef880548cf5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:17.239888 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8f239a40-1ee2-4f40-bdc1-3ef880548cf5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:17.240334 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8f239a40-1ee2-4f40-bdc1-3ef880548cf5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:17.241082 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8f239a40-1ee2-4f40-bdc1-3ef880548cf5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:17.241520 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8f239a40-1ee2-4f40-bdc1-3ef880548cf5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:17.373855 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8f239a40-1ee2-4f40-bdc1-3ef880548cf5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:17.381696 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8f239a40-1ee2-4f40-bdc1-3ef880548cf5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:17.383227 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8f239a40-1ee2-4f40-bdc1-3ef880548cf5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:17.384414 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8f239a40-1ee2-4f40-bdc1-3ef880548cf5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1731 microversion: 2.20 time: 0.155594 Jun 16 16:23:17.384979 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 547/1093] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:17 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:18.402659 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a8e501aa-43be-4c4a-b655-ec91db58ed6d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:18.403195 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a8e501aa-43be-4c4a-b655-ec91db58ed6d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:18.409743 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a8e501aa-43be-4c4a-b655-ec91db58ed6d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:18.410203 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a8e501aa-43be-4c4a-b655-ec91db58ed6d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:18.410997 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a8e501aa-43be-4c4a-b655-ec91db58ed6d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:18.411425 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a8e501aa-43be-4c4a-b655-ec91db58ed6d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:18.543296 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a8e501aa-43be-4c4a-b655-ec91db58ed6d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:18.551298 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a8e501aa-43be-4c4a-b655-ec91db58ed6d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:18.553324 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a8e501aa-43be-4c4a-b655-ec91db58ed6d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:18.554495 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a8e501aa-43be-4c4a-b655-ec91db58ed6d tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1731 microversion: 2.20 time: 0.155903 Jun 16 16:23:18.555047 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 547/1094] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:18 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:19.574108 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9c9c16f5-9f54-42b5-9525-3459a03b0b50 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:19.574972 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9c9c16f5-9f54-42b5-9525-3459a03b0b50 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:19.582063 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c9c16f5-9f54-42b5-9525-3459a03b0b50 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:19.582552 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c9c16f5-9f54-42b5-9525-3459a03b0b50 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:19.583324 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c9c16f5-9f54-42b5-9525-3459a03b0b50 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:19.583788 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9c9c16f5-9f54-42b5-9525-3459a03b0b50 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:19.719560 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9c9c16f5-9f54-42b5-9525-3459a03b0b50 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:19.727893 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9c9c16f5-9f54-42b5-9525-3459a03b0b50 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:19.729381 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9c9c16f5-9f54-42b5-9525-3459a03b0b50 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:19.730563 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9c9c16f5-9f54-42b5-9525-3459a03b0b50 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1731 microversion: 2.20 time: 0.162002 Jun 16 16:23:19.731119 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 548/1095] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:19 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:20.749119 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3af96f39-0be0-4297-a23b-f77f0a4526b8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:20.749773 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3af96f39-0be0-4297-a23b-f77f0a4526b8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:20.757020 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3af96f39-0be0-4297-a23b-f77f0a4526b8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:20.757466 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3af96f39-0be0-4297-a23b-f77f0a4526b8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:20.758250 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3af96f39-0be0-4297-a23b-f77f0a4526b8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:20.758684 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3af96f39-0be0-4297-a23b-f77f0a4526b8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:20.890171 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3af96f39-0be0-4297-a23b-f77f0a4526b8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:20.898648 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3af96f39-0be0-4297-a23b-f77f0a4526b8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:20.900538 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3af96f39-0be0-4297-a23b-f77f0a4526b8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:20.901764 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3af96f39-0be0-4297-a23b-f77f0a4526b8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1731 microversion: 2.20 time: 0.156551 Jun 16 16:23:20.902518 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 548/1096] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:20 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:21.920507 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e3bf5caa-eaad-4a60-a61a-8ffb197650e4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:21.921146 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e3bf5caa-eaad-4a60-a61a-8ffb197650e4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:21.928232 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e3bf5caa-eaad-4a60-a61a-8ffb197650e4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:21.928681 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e3bf5caa-eaad-4a60-a61a-8ffb197650e4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:21.929441 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e3bf5caa-eaad-4a60-a61a-8ffb197650e4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:21.929916 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e3bf5caa-eaad-4a60-a61a-8ffb197650e4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:22.062059 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e3bf5caa-eaad-4a60-a61a-8ffb197650e4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:22.071508 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e3bf5caa-eaad-4a60-a61a-8ffb197650e4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:22.073000 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e3bf5caa-eaad-4a60-a61a-8ffb197650e4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:22.074184 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e3bf5caa-eaad-4a60-a61a-8ffb197650e4 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1731 microversion: 2.20 time: 0.157678 Jun 16 16:23:22.074743 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 549/1097] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:21 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:22.213895 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-1796ef40-7852-42b6-9f3d-c3b05b60af58 req-4d7b8627-0f52-454e-946b-5a153db5e835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f151b6-bfce-4c42-932f-7be72f7da4b4", "name": "network-vif-plugged", "status": "completed", "tag": "44d3a737-8fd0-480a-b4eb-2bc5eb327a3f"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:23:22.223367 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-1796ef40-7852-42b6-9f3d-c3b05b60af58 req-4d7b8627-0f52-454e-946b-5a153db5e835 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:22.223809 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-1796ef40-7852-42b6-9f3d-c3b05b60af58 req-4d7b8627-0f52-454e-946b-5a153db5e835 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:22.235454 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-1796ef40-7852-42b6-9f3d-c3b05b60af58 req-4d7b8627-0f52-454e-946b-5a153db5e835 service nova] Creating event network-vif-plugged:44d3a737-8fd0-480a-b4eb-2bc5eb327a3f for instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 on hv-cinder-83735 Jun 16 16:23:22.241035 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-1796ef40-7852-42b6-9f3d-c3b05b60af58 req-4d7b8627-0f52-454e-946b-5a153db5e835 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031013 Jun 16 16:23:22.241649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 549/1098] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:23:23.092344 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6f8e2f6f-6004-4329-bd61-5b5bf6de3b33 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:23.092948 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6f8e2f6f-6004-4329-bd61-5b5bf6de3b33 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:23.095243 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=32 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:23.100826 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6f8e2f6f-6004-4329-bd61-5b5bf6de3b33 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:23.101286 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6f8e2f6f-6004-4329-bd61-5b5bf6de3b33 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:23.102064 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6f8e2f6f-6004-4329-bd61-5b5bf6de3b33 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:23.102497 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6f8e2f6f-6004-4329-bd61-5b5bf6de3b33 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:23.236538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6f8e2f6f-6004-4329-bd61-5b5bf6de3b33 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:23.244886 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6f8e2f6f-6004-4329-bd61-5b5bf6de3b33 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:23.246404 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6f8e2f6f-6004-4329-bd61-5b5bf6de3b33 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:23.247547 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6f8e2f6f-6004-4329-bd61-5b5bf6de3b33 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1731 microversion: 2.20 time: 0.159172 Jun 16 16:23:23.248100 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 550/1099] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:23 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:24.268380 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-37c56e75-3abf-4d64-9460-905b88a8dba5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:24.269099 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-37c56e75-3abf-4d64-9460-905b88a8dba5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:24.275422 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-37c56e75-3abf-4d64-9460-905b88a8dba5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:24.275873 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-37c56e75-3abf-4d64-9460-905b88a8dba5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:24.276636 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-37c56e75-3abf-4d64-9460-905b88a8dba5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:24.277070 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-37c56e75-3abf-4d64-9460-905b88a8dba5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:24.404508 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-37c56e75-3abf-4d64-9460-905b88a8dba5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:24.413427 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-37c56e75-3abf-4d64-9460-905b88a8dba5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:24.415018 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-37c56e75-3abf-4d64-9460-905b88a8dba5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:24.416110 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-37c56e75-3abf-4d64-9460-905b88a8dba5 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1731 microversion: 2.20 time: 0.153625 Jun 16 16:23:24.416672 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 550/1100] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:24 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:23:25.434539 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0b5de414-c654-4e15-9fbb-e398b3e184c8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:25.435148 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0b5de414-c654-4e15-9fbb-e398b3e184c8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:25.441621 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0b5de414-c654-4e15-9fbb-e398b3e184c8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:25.442104 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0b5de414-c654-4e15-9fbb-e398b3e184c8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:25.442865 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0b5de414-c654-4e15-9fbb-e398b3e184c8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:25.443301 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0b5de414-c654-4e15-9fbb-e398b3e184c8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:25.578004 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0b5de414-c654-4e15-9fbb-e398b3e184c8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:25.586670 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0b5de414-c654-4e15-9fbb-e398b3e184c8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:25.588175 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0b5de414-c654-4e15-9fbb-e398b3e184c8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:25.589321 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0b5de414-c654-4e15-9fbb-e398b3e184c8 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1718 microversion: 2.20 time: 0.158741 Jun 16 16:23:25.589907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 551/1101] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:23:25 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:23:42.240447 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bf38a361-1ac9-4a95-a9a5-5f6b7079c84e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:42.240992 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-bf38a361-1ac9-4a95-a9a5-5f6b7079c84e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:42.243217 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=11 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:42.243862 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:42.249638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bf38a361-1ac9-4a95-a9a5-5f6b7079c84e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:42.250119 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bf38a361-1ac9-4a95-a9a5-5f6b7079c84e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:42.250875 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bf38a361-1ac9-4a95-a9a5-5f6b7079c84e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:42.251310 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bf38a361-1ac9-4a95-a9a5-5f6b7079c84e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:42.277998 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-bf38a361-1ac9-4a95-a9a5-5f6b7079c84e tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56/ips" status: 200 len: 145 microversion: 2.1 time: 0.042007 Jun 16 16:23:42.278561 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 551/1102] 10.222.0.88 () {58 vars in 1247 bytes} [Thu Jun 16 16:23:42 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:23:44.285383 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fa8652e3-9477-4ef0-9046-eaf72c6d022c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f58cd020-58e2-45de-95df-8e0bd23108c5"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:23:44.286501 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fa8652e3-9477-4ef0-9046-eaf72c6d022c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:44.288504 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:44.289275 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=69 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:44.294988 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fa8652e3-9477-4ef0-9046-eaf72c6d022c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:44.295441 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fa8652e3-9477-4ef0-9046-eaf72c6d022c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:44.296217 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fa8652e3-9477-4ef0-9046-eaf72c6d022c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:44.296657 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fa8652e3-9477-4ef0-9046-eaf72c6d022c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:44.560554 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fa8652e3-9477-4ef0-9046-eaf72c6d022c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "POST /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279032 Jun 16 16:23:44.561179 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 552/1103] 10.222.0.88 () {60 vars in 1322 bytes} [Thu Jun 16 16:23:44 2022] POST /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:23:52.043046 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5d32771b-486e-46d1-9941-0e1bc91bbbd8 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:23:52.049481 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5d32771b-486e-46d1-9941-0e1bc91bbbd8 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:52.049967 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5d32771b-486e-46d1-9941-0e1bc91bbbd8 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:52.109564 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5d32771b-486e-46d1-9941-0e1bc91bbbd8 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Going to try to stop instance {{(pid=117711) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 16:23:52.151799 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5d32771b-486e-46d1-9941-0e1bc91bbbd8 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "POST /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56/action" status: 202 len: 0 microversion: 2.1 time: 0.112467 Jun 16 16:23:52.152409 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 552/1104] 10.222.0.88 () {60 vars in 1277 bytes} [Thu Jun 16 16:23:52 2022] POST /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:23:52.162217 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-5f6133a6-a730-4f7a-8e84-ff4804c31ceb tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:52.162948 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-5f6133a6-a730-4f7a-8e84-ff4804c31ceb tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:52.169042 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5f6133a6-a730-4f7a-8e84-ff4804c31ceb tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:52.169504 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5f6133a6-a730-4f7a-8e84-ff4804c31ceb tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:52.170306 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5f6133a6-a730-4f7a-8e84-ff4804c31ceb tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:52.170756 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-5f6133a6-a730-4f7a-8e84-ff4804c31ceb tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:52.304209 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-5f6133a6-a730-4f7a-8e84-ff4804c31ceb tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:52.312159 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-5f6133a6-a730-4f7a-8e84-ff4804c31ceb tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1723 microversion: 2.1 time: 0.155299 Jun 16 16:23:52.312729 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 553/1105] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:23:52 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:23:53.330945 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9c194178-3a48-4e23-817b-1d5b033171b6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:53.331634 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9c194178-3a48-4e23-817b-1d5b033171b6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:53.338398 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9c194178-3a48-4e23-817b-1d5b033171b6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:53.338850 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9c194178-3a48-4e23-817b-1d5b033171b6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:53.339590 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9c194178-3a48-4e23-817b-1d5b033171b6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:53.340020 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9c194178-3a48-4e23-817b-1d5b033171b6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:53.470031 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9c194178-3a48-4e23-817b-1d5b033171b6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:53.478161 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9c194178-3a48-4e23-817b-1d5b033171b6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1723 microversion: 2.1 time: 0.152038 Jun 16 16:23:53.478718 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 553/1106] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:23:53 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:23:54.495752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9f3691ae-47b8-4731-9b43-3afc79bec361 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:54.496300 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9f3691ae-47b8-4731-9b43-3afc79bec361 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:54.503159 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9f3691ae-47b8-4731-9b43-3afc79bec361 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:54.503603 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9f3691ae-47b8-4731-9b43-3afc79bec361 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:54.504921 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9f3691ae-47b8-4731-9b43-3afc79bec361 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:54.505347 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9f3691ae-47b8-4731-9b43-3afc79bec361 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:54.632154 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9f3691ae-47b8-4731-9b43-3afc79bec361 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:54.640446 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9f3691ae-47b8-4731-9b43-3afc79bec361 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1723 microversion: 2.1 time: 0.148645 Jun 16 16:23:54.641009 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 554/1107] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:23:54 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:23:55.657475 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9df66a0c-5cb3-404b-9809-3fd0bd20a54c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:55.658108 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9df66a0c-5cb3-404b-9809-3fd0bd20a54c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:55.664608 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9df66a0c-5cb3-404b-9809-3fd0bd20a54c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:55.665048 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9df66a0c-5cb3-404b-9809-3fd0bd20a54c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:55.665829 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9df66a0c-5cb3-404b-9809-3fd0bd20a54c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:55.666259 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9df66a0c-5cb3-404b-9809-3fd0bd20a54c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:55.793157 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9df66a0c-5cb3-404b-9809-3fd0bd20a54c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:55.801152 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9df66a0c-5cb3-404b-9809-3fd0bd20a54c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1723 microversion: 2.1 time: 0.147556 Jun 16 16:23:55.801746 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 554/1108] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:23:55 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:23:56.817972 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fe2ede2f-ace8-419c-b31d-65fb2d980680 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:56.818589 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fe2ede2f-ace8-419c-b31d-65fb2d980680 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:56.825228 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fe2ede2f-ace8-419c-b31d-65fb2d980680 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:56.825680 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fe2ede2f-ace8-419c-b31d-65fb2d980680 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:56.826477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fe2ede2f-ace8-419c-b31d-65fb2d980680 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:56.826915 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fe2ede2f-ace8-419c-b31d-65fb2d980680 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:56.958172 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-fe2ede2f-ace8-419c-b31d-65fb2d980680 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:56.966061 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fe2ede2f-ace8-419c-b31d-65fb2d980680 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1723 microversion: 2.1 time: 0.151927 Jun 16 16:23:56.966623 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 555/1109] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:23:56 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:23:57.984284 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-77f6f628-529e-4ca8-a8f5-25d6ab8aca63 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:57.984958 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-77f6f628-529e-4ca8-a8f5-25d6ab8aca63 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:57.991286 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-77f6f628-529e-4ca8-a8f5-25d6ab8aca63 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:57.991735 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-77f6f628-529e-4ca8-a8f5-25d6ab8aca63 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:57.992483 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-77f6f628-529e-4ca8-a8f5-25d6ab8aca63 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:57.992911 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-77f6f628-529e-4ca8-a8f5-25d6ab8aca63 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:58.121336 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-77f6f628-529e-4ca8-a8f5-25d6ab8aca63 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:58.129980 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-77f6f628-529e-4ca8-a8f5-25d6ab8aca63 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1723 microversion: 2.1 time: 0.149523 Jun 16 16:23:58.130551 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 555/1110] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:23:57 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:23:59.148222 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-deacc68d-c28f-489d-8c60-8c37a14fa50f tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:23:59.148835 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-deacc68d-c28f-489d-8c60-8c37a14fa50f tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:23:59.155389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-deacc68d-c28f-489d-8c60-8c37a14fa50f tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:59.155839 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-deacc68d-c28f-489d-8c60-8c37a14fa50f tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:59.156599 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-deacc68d-c28f-489d-8c60-8c37a14fa50f tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:23:59.157036 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-deacc68d-c28f-489d-8c60-8c37a14fa50f tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:23:59.287917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-deacc68d-c28f-489d-8c60-8c37a14fa50f tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:23:59.295743 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-deacc68d-c28f-489d-8c60-8c37a14fa50f tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1723 microversion: 2.1 time: 0.152207 Jun 16 16:23:59.296305 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 556/1111] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:23:59 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:00.312293 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f1f4d5cf-ed6d-46fa-a191-0b55a2f46df1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:00.312895 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f1f4d5cf-ed6d-46fa-a191-0b55a2f46df1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:00.319360 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f1f4d5cf-ed6d-46fa-a191-0b55a2f46df1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:00.319805 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f1f4d5cf-ed6d-46fa-a191-0b55a2f46df1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:00.320548 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f1f4d5cf-ed6d-46fa-a191-0b55a2f46df1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:00.320975 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f1f4d5cf-ed6d-46fa-a191-0b55a2f46df1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:00.451735 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f1f4d5cf-ed6d-46fa-a191-0b55a2f46df1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:00.459565 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f1f4d5cf-ed6d-46fa-a191-0b55a2f46df1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1723 microversion: 2.1 time: 0.151080 Jun 16 16:24:00.460125 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 556/1112] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:00 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:01.477179 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7a006be6-2392-466e-86df-e15c2e4e60d6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:01.477752 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7a006be6-2392-466e-86df-e15c2e4e60d6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:01.484234 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7a006be6-2392-466e-86df-e15c2e4e60d6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:01.484679 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7a006be6-2392-466e-86df-e15c2e4e60d6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:01.485431 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7a006be6-2392-466e-86df-e15c2e4e60d6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:01.485894 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7a006be6-2392-466e-86df-e15c2e4e60d6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:01.624929 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7a006be6-2392-466e-86df-e15c2e4e60d6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:01.633280 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7a006be6-2392-466e-86df-e15c2e4e60d6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1723 microversion: 2.1 time: 0.160545 Jun 16 16:24:01.633865 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 557/1113] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:01 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:02.650426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-930fc92e-5291-4537-ac8b-815f483c444b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:02.650948 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-930fc92e-5291-4537-ac8b-815f483c444b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:02.656996 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-930fc92e-5291-4537-ac8b-815f483c444b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:02.657451 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-930fc92e-5291-4537-ac8b-815f483c444b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:02.658258 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-930fc92e-5291-4537-ac8b-815f483c444b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:02.658701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-930fc92e-5291-4537-ac8b-815f483c444b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:02.785167 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-930fc92e-5291-4537-ac8b-815f483c444b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:02.793101 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-930fc92e-5291-4537-ac8b-815f483c444b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1723 microversion: 2.1 time: 0.146764 Jun 16 16:24:02.793670 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 557/1114] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:02 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:03.810890 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c48fdbbb-1a65-4099-bee4-05192c06d396 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:03.811519 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c48fdbbb-1a65-4099-bee4-05192c06d396 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:03.818565 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c48fdbbb-1a65-4099-bee4-05192c06d396 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:03.819022 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c48fdbbb-1a65-4099-bee4-05192c06d396 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:03.819786 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c48fdbbb-1a65-4099-bee4-05192c06d396 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:03.820258 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c48fdbbb-1a65-4099-bee4-05192c06d396 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:03.947072 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c48fdbbb-1a65-4099-bee4-05192c06d396 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:03.955142 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c48fdbbb-1a65-4099-bee4-05192c06d396 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1723 microversion: 2.1 time: 0.148330 Jun 16 16:24:03.955719 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 558/1115] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:03 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:04.972934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-810cd6f1-bebb-4496-9181-046acfca00a1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:04.973546 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-810cd6f1-bebb-4496-9181-046acfca00a1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:04.980123 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-810cd6f1-bebb-4496-9181-046acfca00a1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:04.980572 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-810cd6f1-bebb-4496-9181-046acfca00a1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:04.981326 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-810cd6f1-bebb-4496-9181-046acfca00a1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:04.981782 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-810cd6f1-bebb-4496-9181-046acfca00a1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:05.113441 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-810cd6f1-bebb-4496-9181-046acfca00a1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:05.121369 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-810cd6f1-bebb-4496-9181-046acfca00a1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1723 microversion: 2.1 time: 0.153136 Jun 16 16:24:05.121963 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 558/1116] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:04 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:06.138418 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d091b612-5d2a-4682-8292-63d6e8703694 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:06.139028 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d091b612-5d2a-4682-8292-63d6e8703694 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:06.146730 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d091b612-5d2a-4682-8292-63d6e8703694 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:06.147174 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d091b612-5d2a-4682-8292-63d6e8703694 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:06.147936 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d091b612-5d2a-4682-8292-63d6e8703694 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:06.148366 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d091b612-5d2a-4682-8292-63d6e8703694 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:06.275033 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d091b612-5d2a-4682-8292-63d6e8703694 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:06.282885 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d091b612-5d2a-4682-8292-63d6e8703694 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1723 microversion: 2.1 time: 0.148364 Jun 16 16:24:06.283455 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 559/1117] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:06 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:07.299772 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8bbb95c0-6fce-4081-ad54-4a990e153868 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:07.300897 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8bbb95c0-6fce-4081-ad54-4a990e153868 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:07.307304 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8bbb95c0-6fce-4081-ad54-4a990e153868 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:07.307746 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8bbb95c0-6fce-4081-ad54-4a990e153868 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:07.308483 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8bbb95c0-6fce-4081-ad54-4a990e153868 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:07.308910 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8bbb95c0-6fce-4081-ad54-4a990e153868 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:07.437997 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8bbb95c0-6fce-4081-ad54-4a990e153868 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:07.446498 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8bbb95c0-6fce-4081-ad54-4a990e153868 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1723 microversion: 2.1 time: 0.150568 Jun 16 16:24:07.447067 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 559/1118] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:07 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:08.463848 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-97e43196-6be1-4d67-912c-d86b2315b429 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:08.464387 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-97e43196-6be1-4d67-912c-d86b2315b429 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:08.470915 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-97e43196-6be1-4d67-912c-d86b2315b429 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:08.471376 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-97e43196-6be1-4d67-912c-d86b2315b429 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:08.472405 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-97e43196-6be1-4d67-912c-d86b2315b429 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:08.472851 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-97e43196-6be1-4d67-912c-d86b2315b429 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:08.599591 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-97e43196-6be1-4d67-912c-d86b2315b429 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:08.607542 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-97e43196-6be1-4d67-912c-d86b2315b429 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1700 microversion: 2.1 time: 0.147652 Jun 16 16:24:08.608107 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 560/1119] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:08 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1700 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:08.626653 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f4b7509d-50bf-43e3-b1c1-4f9f5f8a9280 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:24:08.634263 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f4b7509d-50bf-43e3-b1c1-4f9f5f8a9280 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:08.634713 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f4b7509d-50bf-43e3-b1c1-4f9f5f8a9280 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:08.656786 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f4b7509d-50bf-43e3-b1c1-4f9f5f8a9280 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Going to try to start instance {{(pid=117711) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 16:24:08.698566 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f4b7509d-50bf-43e3-b1c1-4f9f5f8a9280 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "POST /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56/action" status: 202 len: 0 microversion: 2.1 time: 0.075811 Jun 16 16:24:08.699159 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 560/1120] 10.222.0.88 () {60 vars in 1277 bytes} [Thu Jun 16 16:24:08 2022] POST /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:24:08.707690 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2f28843e-8760-4617-9533-23c53bc2b0e0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:08.708342 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2f28843e-8760-4617-9533-23c53bc2b0e0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:08.714915 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2f28843e-8760-4617-9533-23c53bc2b0e0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:08.715313 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2f28843e-8760-4617-9533-23c53bc2b0e0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:08.716197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2f28843e-8760-4617-9533-23c53bc2b0e0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:08.716657 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2f28843e-8760-4617-9533-23c53bc2b0e0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:08.845690 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-2f28843e-8760-4617-9533-23c53bc2b0e0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:08.854893 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2f28843e-8760-4617-9533-23c53bc2b0e0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1709 microversion: 2.1 time: 0.151462 Jun 16 16:24:08.855478 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 561/1121] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:08 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1709 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:09.873060 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9470fdb8-6af6-44b6-a45e-b7774308a807 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:09.873822 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9470fdb8-6af6-44b6-a45e-b7774308a807 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:09.880012 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9470fdb8-6af6-44b6-a45e-b7774308a807 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:09.880459 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9470fdb8-6af6-44b6-a45e-b7774308a807 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:09.881211 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9470fdb8-6af6-44b6-a45e-b7774308a807 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:09.881648 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9470fdb8-6af6-44b6-a45e-b7774308a807 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:10.014447 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-9470fdb8-6af6-44b6-a45e-b7774308a807 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:10.022321 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9470fdb8-6af6-44b6-a45e-b7774308a807 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1709 microversion: 2.1 time: 0.153957 Jun 16 16:24:10.022890 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 561/1122] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:09 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:11.039836 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a13722fb-78ae-4044-88d8-8f56189c0eb0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:11.040455 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a13722fb-78ae-4044-88d8-8f56189c0eb0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:11.046993 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a13722fb-78ae-4044-88d8-8f56189c0eb0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:11.047442 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a13722fb-78ae-4044-88d8-8f56189c0eb0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:11.048208 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a13722fb-78ae-4044-88d8-8f56189c0eb0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:11.048648 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a13722fb-78ae-4044-88d8-8f56189c0eb0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:11.176049 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a13722fb-78ae-4044-88d8-8f56189c0eb0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:11.183915 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a13722fb-78ae-4044-88d8-8f56189c0eb0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1713 microversion: 2.1 time: 0.148045 Jun 16 16:24:11.184474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 562/1123] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:11 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1713 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:15.348264 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a4de2ceb-da66-419b-88cd-eaef30845af3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:15.348828 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a4de2ceb-da66-419b-88cd-eaef30845af3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:15.351313 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=23 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:15.357019 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a4de2ceb-da66-419b-88cd-eaef30845af3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:15.357467 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a4de2ceb-da66-419b-88cd-eaef30845af3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:15.358261 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a4de2ceb-da66-419b-88cd-eaef30845af3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:15.358698 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a4de2ceb-da66-419b-88cd-eaef30845af3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:15.361198 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:15.384499 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a4de2ceb-da66-419b-88cd-eaef30845af3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338/ips" status: 200 len: 150 microversion: 2.1 time: 0.040600 Jun 16 16:24:15.385071 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 562/1124] 10.222.0.88 () {58 vars in 1247 bytes} [Thu Jun 16 16:24:15 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:24:16.695540 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-315d56fe-8c68-44aa-bc61-6e26576cdf50 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c227855-ab87-4b18-85cd-75bfb42657bb"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:24:16.696661 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-315d56fe-8c68-44aa-bc61-6e26576cdf50 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:16.699271 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=23 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:16.704994 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-315d56fe-8c68-44aa-bc61-6e26576cdf50 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:16.705446 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-315d56fe-8c68-44aa-bc61-6e26576cdf50 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:16.706326 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-315d56fe-8c68-44aa-bc61-6e26576cdf50 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:16.707306 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-315d56fe-8c68-44aa-bc61-6e26576cdf50 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:16.710914 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:16.965838 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-315d56fe-8c68-44aa-bc61-6e26576cdf50 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "POST /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274631 Jun 16 16:24:16.966660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 563/1125] 10.222.0.88 () {60 vars in 1322 bytes} [Thu Jun 16 16:24:16 2022] POST /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:24:24.535987 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-16c3e0bc-2a30-490e-b522-75f6504c9be3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:24.536475 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-16c3e0bc-2a30-490e-b522-75f6504c9be3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:24.543055 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-16c3e0bc-2a30-490e-b522-75f6504c9be3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:24.543498 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-16c3e0bc-2a30-490e-b522-75f6504c9be3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:24.544242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-16c3e0bc-2a30-490e-b522-75f6504c9be3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:24.544671 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-16c3e0bc-2a30-490e-b522-75f6504c9be3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:24.629523 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-16c3e0bc-2a30-490e-b522-75f6504c9be3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lazy-loading 'services' on Instance uuid a598febb-d1e1-4593-8547-bc0075f39338 {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:24:24.700293 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-16c3e0bc-2a30-490e-b522-75f6504c9be3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338/os-volume_attachments/7c227855-ab87-4b18-85cd-75bfb42657bb" status: 202 len: 0 microversion: 2.1 time: 0.168197 Jun 16 16:24:24.700904 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 563/1126] 10.222.0.88 () {58 vars in 1415 bytes} [Thu Jun 16 16:24:24 2022] DELETE /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338/os-volume_attachments/7c227855-ab87-4b18-85cd-75bfb42657bb => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:24:24.710516 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-18377076-02aa-4261-bb31-ec5a479b93da tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:24.711593 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-18377076-02aa-4261-bb31-ec5a479b93da tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:24.718784 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-18377076-02aa-4261-bb31-ec5a479b93da tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:24.719213 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-18377076-02aa-4261-bb31-ec5a479b93da tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:24.720073 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-18377076-02aa-4261-bb31-ec5a479b93da tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:24.720516 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-18377076-02aa-4261-bb31-ec5a479b93da tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:24.750312 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-18377076-02aa-4261-bb31-ec5a479b93da tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044728 Jun 16 16:24:24.754230 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 564/1127] 10.222.0.88 () {58 vars in 1301 bytes} [Thu Jun 16 16:24:24 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:24:25.763378 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-427586ac-b196-4083-9089-40616f6639f0 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:25.764449 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-427586ac-b196-4083-9089-40616f6639f0 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:25.771961 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-427586ac-b196-4083-9089-40616f6639f0 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:25.772444 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-427586ac-b196-4083-9089-40616f6639f0 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:25.773209 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-427586ac-b196-4083-9089-40616f6639f0 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:25.773650 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-427586ac-b196-4083-9089-40616f6639f0 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:25.802895 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-427586ac-b196-4083-9089-40616f6639f0 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043967 Jun 16 16:24:25.803467 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 564/1128] 10.222.0.88 () {58 vars in 1301 bytes} [Thu Jun 16 16:24:25 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:24:25.866254 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-402c4159-117d-4360-a201-c5e13f9e5103 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:25.866783 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-402c4159-117d-4360-a201-c5e13f9e5103 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:25.873226 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-402c4159-117d-4360-a201-c5e13f9e5103 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:25.873676 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-402c4159-117d-4360-a201-c5e13f9e5103 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:25.874474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-402c4159-117d-4360-a201-c5e13f9e5103 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:25.874910 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-402c4159-117d-4360-a201-c5e13f9e5103 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:25.900153 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-402c4159-117d-4360-a201-c5e13f9e5103 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:24:25.977944 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-402c4159-117d-4360-a201-c5e13f9e5103 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 204 len: 0 microversion: 2.1 time: 0.115770 Jun 16 16:24:25.978539 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 565/1129] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:24:25 2022] DELETE /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:24:25.986736 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-25be9798-f0b7-4145-b588-717562c549e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:25.987879 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-25be9798-f0b7-4145-b588-717562c549e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:25.993762 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-25be9798-f0b7-4145-b588-717562c549e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:25.994227 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-25be9798-f0b7-4145-b588-717562c549e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:25.994955 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-25be9798-f0b7-4145-b588-717562c549e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:25.995382 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-25be9798-f0b7-4145-b588-717562c549e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:26.139066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-25be9798-f0b7-4145-b588-717562c549e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:26.147163 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-25be9798-f0b7-4145-b588-717562c549e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 200 len: 1682 microversion: 2.1 time: 0.164259 Jun 16 16:24:26.147718 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 565/1130] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:25 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:27.164656 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7ead5b94-fd73-4fbf-b772-4d6e37d4caf9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:27.165301 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7ead5b94-fd73-4fbf-b772-4d6e37d4caf9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:27.171871 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7ead5b94-fd73-4fbf-b772-4d6e37d4caf9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:27.172325 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7ead5b94-fd73-4fbf-b772-4d6e37d4caf9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:27.173084 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7ead5b94-fd73-4fbf-b772-4d6e37d4caf9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:27.173524 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7ead5b94-fd73-4fbf-b772-4d6e37d4caf9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:27.300192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-7ead5b94-fd73-4fbf-b772-4d6e37d4caf9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:27.307640 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7ead5b94-fd73-4fbf-b772-4d6e37d4caf9 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 200 len: 1682 microversion: 2.1 time: 0.147317 Jun 16 16:24:27.308201 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 566/1131] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:27 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:24:28.325057 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1ae510ea-a4f3-4cf6-83cb-c7dade93ca9a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:28.325657 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1ae510ea-a4f3-4cf6-83cb-c7dade93ca9a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:28.332985 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1ae510ea-a4f3-4cf6-83cb-c7dade93ca9a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:28.333439 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1ae510ea-a4f3-4cf6-83cb-c7dade93ca9a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:28.334238 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1ae510ea-a4f3-4cf6-83cb-c7dade93ca9a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:28.334678 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1ae510ea-a4f3-4cf6-83cb-c7dade93ca9a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:28.535082 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1ae510ea-a4f3-4cf6-83cb-c7dade93ca9a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:28.542604 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1ae510ea-a4f3-4cf6-83cb-c7dade93ca9a tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 200 len: 1682 microversion: 2.1 time: 0.221466 Jun 16 16:24:28.543167 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 566/1132] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:28 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 1682 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:29.550998 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-d5eb33f6-9ed1-4f66-959b-3d1e206aab83 req-92cccf7e-981d-43db-8476-62d803946f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a598febb-d1e1-4593-8547-bc0075f39338", "name": "network-vif-deleted", "tag": "7d6dbef9-8302-4765-a850-0e7746870788"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:24:29.560228 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-526a7757-8b8d-4cb2-a3bf-6758a220f5d5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:29.560841 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-526a7757-8b8d-4cb2-a3bf-6758a220f5d5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:29.568216 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-d5eb33f6-9ed1-4f66-959b-3d1e206aab83 req-92cccf7e-981d-43db-8476-62d803946f51 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:29.568660 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-d5eb33f6-9ed1-4f66-959b-3d1e206aab83 req-92cccf7e-981d-43db-8476-62d803946f51 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:29.570180 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-526a7757-8b8d-4cb2-a3bf-6758a220f5d5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:29.570830 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-526a7757-8b8d-4cb2-a3bf-6758a220f5d5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:29.571783 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-526a7757-8b8d-4cb2-a3bf-6758a220f5d5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:29.572562 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-526a7757-8b8d-4cb2-a3bf-6758a220f5d5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:29.586041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-d5eb33f6-9ed1-4f66-959b-3d1e206aab83 req-92cccf7e-981d-43db-8476-62d803946f51 service nova] Creating event network-vif-deleted:7d6dbef9-8302-4765-a850-0e7746870788 for instance a598febb-d1e1-4593-8547-bc0075f39338 on hv-cinder-83735 Jun 16 16:24:29.591768 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-d5eb33f6-9ed1-4f66-959b-3d1e206aab83 req-92cccf7e-981d-43db-8476-62d803946f51 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104522 Jun 16 16:24:29.594840 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 567/1133] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:24:29.669011 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-526a7757-8b8d-4cb2-a3bf-6758a220f5d5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfbcc9b45bc341228bcc0f2192040224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1cdf363c2e44af5b0d8cd748c58235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:29.679123 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-526a7757-8b8d-4cb2-a3bf-6758a220f5d5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 200 len: 1327 microversion: 2.1 time: 0.122594 Jun 16 16:24:29.679944 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 567/1134] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:29 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 1327 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:24:30.697086 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-165a10bb-9e6a-42ba-bc88-c245b1bcf972 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:30.697825 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-165a10bb-9e6a-42ba-bc88-c245b1bcf972 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:30.704000 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-165a10bb-9e6a-42ba-bc88-c245b1bcf972 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:30.704448 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-165a10bb-9e6a-42ba-bc88-c245b1bcf972 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:30.705206 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-165a10bb-9e6a-42ba-bc88-c245b1bcf972 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:30.706172 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-165a10bb-9e6a-42ba-bc88-c245b1bcf972 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:30.719307 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-165a10bb-9e6a-42ba-bc88-c245b1bcf972 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] HTTP exception thrown: Instance a598febb-d1e1-4593-8547-bc0075f39338 could not be found. Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-165a10bb-9e6a-42ba-bc88-c245b1bcf972 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Request method failure captured: Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 HTTP/1.1 Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1Z8eNcA8LvE_QGupE8IwZgqoLdb4bdar2JFxF-sM8vVrpRiD1EIWMp99ewnT5la5EmpgmBAQZOsVfs3XmSmDWWlPn9Df8pyp8HGhxHfE9ShSTZ5F3NEdcePS6LELsIFGFBpMHeDDC0nVbCEOCxMglGuS8woh2jjuJT6Oy7NXlIFCC8 Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:24:30.720907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:24:30.723556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c1cdf363c2e44af5b0d8cd748c58235b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:24:30.723556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:30.723556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:24:30.723556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:30.723556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:24:30.723556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:24:30.723556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:24:30.723556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: bfbcc9b45bc341228bcc0f2192040224 Jun 16 16:24:30.723556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:24:30.723556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:24:30.723556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Instance a598febb-d1e1-4593-8547-bc0075f39338 could not be found. Jun 16 16:24:30.723556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': 'a598febb-d1e1-4593-8547-bc0075f39338'} Jun 16 16:24:30.724399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:24:30.724399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:30.724399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:24:30.724399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:24:30.724399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:24:30.724399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:24:30.724399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:24:30.724399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:24:30.724399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:24:30.724399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:24:30.724399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a598febb-d1e1-4593-8547-bc0075f39338 could not be found. Jun 16 16:24:30.724399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:30.724399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:30.724399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:30.724399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:30.724399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:30.724399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:30.724399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:24:30.724399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:24:30.724399 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:24:30.725785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:24:30.725785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:24:30.725785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:24:30.725785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:24:30.725785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:24:30.725785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:24:30.725785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:24:30.725785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a598febb-d1e1-4593-8547-bc0075f39338 could not be found. Jun 16 16:24:30.725785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:30.725785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:30.725785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:30.725785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:30.725785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:30.725785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:30.725785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:24:30.725785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:24:30.725785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a598febb-d1e1-4593-8547-bc0075f39338 could not be found. Jun 16 16:24:30.725785 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:30.726985 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-165a10bb-9e6a-42ba-bc88-c245b1bcf972 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Returning 404 to user: Instance a598febb-d1e1-4593-8547-bc0075f39338 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:24:30.726985 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-165a10bb-9e6a-42ba-bc88-c245b1bcf972 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 404 len: 111 microversion: 2.1 time: 0.030725 Jun 16 16:24:30.726985 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 568/1135] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:30 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:24:30.732171 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1fc57533-2e22-4f93-9fe4-047330f5c6c7 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '.version_select at 0x7f6f0d13e0d0>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:30.750113 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1fc57533-2e22-4f93-9fe4-047330f5c6c7 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1593409325" status: 202 len: 0 microversion: 2.1 time: 0.021635 Jun 16 16:24:30.750625 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 568/1136] 10.222.0.88 () {58 vars in 1220 bytes} [Thu Jun 16 16:24:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1593409325 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:24:32.462955 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-781c1789-332f-44c0-8c05-2f16a50cd02a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:32.463868 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-781c1789-332f-44c0-8c05-2f16a50cd02a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:32.471596 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-781c1789-332f-44c0-8c05-2f16a50cd02a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:32.472298 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-781c1789-332f-44c0-8c05-2f16a50cd02a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:32.473060 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-781c1789-332f-44c0-8c05-2f16a50cd02a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:32.473523 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-781c1789-332f-44c0-8c05-2f16a50cd02a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:32.480571 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3daaadc8-de9a-42e6-b8d3-4b4328adf9f5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:32.481096 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3daaadc8-de9a-42e6-b8d3-4b4328adf9f5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:32.487615 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3daaadc8-de9a-42e6-b8d3-4b4328adf9f5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:32.488122 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3daaadc8-de9a-42e6-b8d3-4b4328adf9f5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:32.488882 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3daaadc8-de9a-42e6-b8d3-4b4328adf9f5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:32.489318 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-3daaadc8-de9a-42e6-b8d3-4b4328adf9f5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:32.502617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-3daaadc8-de9a-42e6-b8d3-4b4328adf9f5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] HTTP exception thrown: Instance a598febb-d1e1-4593-8547-bc0075f39338 could not be found. Jun 16 16:24:32.503134 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-781c1789-332f-44c0-8c05-2f16a50cd02a tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044019 Jun 16 16:24:32.503700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 569/1137] 10.222.0.88 () {60 vars in 1342 bytes} [Thu Jun 16 16:24:32 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3daaadc8-de9a-42e6-b8d3-4b4328adf9f5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Request method failure captured: Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: DELETE /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 HTTP/1.1 Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1Z8eNcA8LvE_QGupE8IwZgqoLdb4bdar2JFxF-sM8vVrpRiD1EIWMp99ewnT5la5EmpgmBAQZOsVfs3XmSmDWWlPn9Df8pyp8HGhxHfE9ShSTZ5F3NEdcePS6LELsIFGFBpMHeDDC0nVbCEOCxMglGuS8woh2jjuJT6Oy7NXlIFCC8 Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:24:32.504424 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:24:32.505789 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c1cdf363c2e44af5b0d8cd748c58235b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:24:32.505789 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:32.505789 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:24:32.505789 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:32.505789 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:24:32.505789 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:24:32.505789 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:24:32.505789 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: bfbcc9b45bc341228bcc0f2192040224 Jun 16 16:24:32.505789 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:24:32.505789 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:24:32.505789 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance a598febb-d1e1-4593-8547-bc0075f39338 could not be found. Jun 16 16:24:32.505789 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': 'a598febb-d1e1-4593-8547-bc0075f39338'} Jun 16 16:24:32.506616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:24:32.506616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:32.506616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:24:32.506616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:24:32.506616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:24:32.506616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:24:32.506616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:24:32.506616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:24:32.506616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:24:32.506616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:24:32.506616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a598febb-d1e1-4593-8547-bc0075f39338 could not be found. Jun 16 16:24:32.506616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:32.506616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:32.506616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:32.506616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:32.506616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:32.506616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:32.506616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:24:32.506616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:24:32.506616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:24:32.508588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:24:32.508588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:24:32.508588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:24:32.508588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:24:32.508588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:24:32.508588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:24:32.508588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:24:32.508588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:24:32.508588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:24:32.508588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a598febb-d1e1-4593-8547-bc0075f39338 could not be found. Jun 16 16:24:32.508588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:32.508588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:32.508588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:32.508588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:32.508588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:32.508588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:32.508588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:24:32.508588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:24:32.508588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a598febb-d1e1-4593-8547-bc0075f39338 could not be found. Jun 16 16:24:32.508588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:32.510808 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3daaadc8-de9a-42e6-b8d3-4b4328adf9f5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Returning 404 to user: Instance a598febb-d1e1-4593-8547-bc0075f39338 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:24:32.510808 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3daaadc8-de9a-42e6-b8d3-4b4328adf9f5 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 404 len: 111 microversion: 2.1 time: 0.029269 Jun 16 16:24:32.510808 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 569/1138] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:24:32 2022] DELETE /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:24:32.514370 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fc4857ab-e5ba-472f-b4bc-2a756189fd26 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:32.514975 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fc4857ab-e5ba-472f-b4bc-2a756189fd26 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: a598febb-d1e1-4593-8547-bc0075f39338] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:32.521026 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fc4857ab-e5ba-472f-b4bc-2a756189fd26 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:32.521469 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fc4857ab-e5ba-472f-b4bc-2a756189fd26 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:32.522250 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fc4857ab-e5ba-472f-b4bc-2a756189fd26 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:32.522688 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fc4857ab-e5ba-472f-b4bc-2a756189fd26 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:32.536530 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-fc4857ab-e5ba-472f-b4bc-2a756189fd26 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] HTTP exception thrown: Instance a598febb-d1e1-4593-8547-bc0075f39338 could not be found. Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fc4857ab-e5ba-472f-b4bc-2a756189fd26 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Request method failure captured: Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 HTTP/1.1 Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1Z8eNcA8LvE_QGupE8IwZgqoLdb4bdar2JFxF-sM8vVrpRiD1EIWMp99ewnT5la5EmpgmBAQZOsVfs3XmSmDWWlPn9Df8pyp8HGhxHfE9ShSTZ5F3NEdcePS6LELsIFGFBpMHeDDC0nVbCEOCxMglGuS8woh2jjuJT6Oy7NXlIFCC8 Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:24:32.538087 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:24:32.539700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c1cdf363c2e44af5b0d8cd748c58235b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:24:32.539700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:32.539700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:24:32.539700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:32.539700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:24:32.539700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:24:32.539700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:24:32.539700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: bfbcc9b45bc341228bcc0f2192040224 Jun 16 16:24:32.539700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:24:32.539700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:24:32.539700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Instance a598febb-d1e1-4593-8547-bc0075f39338 could not be found. Jun 16 16:24:32.539700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': 'a598febb-d1e1-4593-8547-bc0075f39338'} Jun 16 16:24:32.540718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:24:32.540718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:32.540718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:24:32.540718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:24:32.540718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:24:32.540718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:24:32.540718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:24:32.540718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:24:32.540718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:24:32.540718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:24:32.540718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a598febb-d1e1-4593-8547-bc0075f39338 could not be found. Jun 16 16:24:32.540718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:32.540718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:32.540718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:32.540718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:32.540718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:32.540718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:32.540718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:24:32.540718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:24:32.540718 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:24:32.542252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:24:32.542252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:24:32.542252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:24:32.542252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:24:32.542252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:24:32.542252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:24:32.542252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:24:32.542252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a598febb-d1e1-4593-8547-bc0075f39338 could not be found. Jun 16 16:24:32.542252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:32.542252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:32.542252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:32.542252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:32.542252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:32.542252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:32.542252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:24:32.542252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:24:32.542252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a598febb-d1e1-4593-8547-bc0075f39338 could not be found. Jun 16 16:24:32.542252 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:32.543546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fc4857ab-e5ba-472f-b4bc-2a756189fd26 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Returning 404 to user: Instance a598febb-d1e1-4593-8547-bc0075f39338 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:24:32.543546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fc4857ab-e5ba-472f-b4bc-2a756189fd26 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338" status: 404 len: 111 microversion: 2.1 time: 0.029052 Jun 16 16:24:32.543546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 570/1139] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:32 2022] GET /compute/v2.1/servers/a598febb-d1e1-4593-8547-bc0075f39338 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:24:32.566506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2a950cc2-2271-4170-b94d-994a67e143ec tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:32.567075 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2a950cc2-2271-4170-b94d-994a67e143ec tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:32.573002 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2a950cc2-2271-4170-b94d-994a67e143ec tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:32.573453 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2a950cc2-2271-4170-b94d-994a67e143ec tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:32.574250 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2a950cc2-2271-4170-b94d-994a67e143ec tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:32.574688 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2a950cc2-2271-4170-b94d-994a67e143ec tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:32.601600 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2a950cc2-2271-4170-b94d-994a67e143ec tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:24:32.679111 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2a950cc2-2271-4170-b94d-994a67e143ec tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "DELETE /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 204 len: 0 microversion: 2.20 time: 0.116698 Jun 16 16:24:32.679616 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 570/1140] 10.222.0.88 () {60 vars in 1279 bytes} [Thu Jun 16 16:24:32 2022] DELETE /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 16:24:32.688117 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c80abc0f-9346-4d57-b919-e6b5b17e7b81 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:32.688828 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c80abc0f-9346-4d57-b919-e6b5b17e7b81 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:32.695533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c80abc0f-9346-4d57-b919-e6b5b17e7b81 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:32.695988 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c80abc0f-9346-4d57-b919-e6b5b17e7b81 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:32.696756 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c80abc0f-9346-4d57-b919-e6b5b17e7b81 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:32.697196 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c80abc0f-9346-4d57-b919-e6b5b17e7b81 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:32.826112 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c80abc0f-9346-4d57-b919-e6b5b17e7b81 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:32.834568 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c80abc0f-9346-4d57-b919-e6b5b17e7b81 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:32.836076 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c80abc0f-9346-4d57-b919-e6b5b17e7b81 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:32.837229 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c80abc0f-9346-4d57-b919-e6b5b17e7b81 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1724 microversion: 2.20 time: 0.153196 Jun 16 16:24:32.837803 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 571/1141] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:32 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:24:33.680561 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fbf45e0f-5bc1-48ce-8d7f-51d1f9dd9454 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:33.681138 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fbf45e0f-5bc1-48ce-8d7f-51d1f9dd9454 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:33.687525 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fbf45e0f-5bc1-48ce-8d7f-51d1f9dd9454 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:33.687960 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fbf45e0f-5bc1-48ce-8d7f-51d1f9dd9454 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:33.688703 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fbf45e0f-5bc1-48ce-8d7f-51d1f9dd9454 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:33.689131 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fbf45e0f-5bc1-48ce-8d7f-51d1f9dd9454 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:33.702689 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-fbf45e0f-5bc1-48ce-8d7f-51d1f9dd9454 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] HTTP exception thrown: Instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 could not be found. Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fbf45e0f-5bc1-48ce-8d7f-51d1f9dd9454 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Request method failure captured: Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: DELETE /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 HTTP/1.1 Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1Z8eNcA8LvE_QGupE8IwZgqoLdb4bdar2JFxF-sM8vVrpRiD1EIWMp99ewnT5la5EmpgmBAQZOsVfs3XmSmDWWlPn9Df8pyp8HGhxHfE9ShSTZ5F3NEdcePS6LELsIFGFBpMHeDDC0nVbCEOCxMglGuS8woh2jjuJT6Oy7NXlIFCC8 Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:24:33.704335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:24:33.706461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c1cdf363c2e44af5b0d8cd748c58235b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:24:33.706461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:33.706461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:24:33.706461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:33.706461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:24:33.706461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:24:33.706461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:24:33.706461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: bfbcc9b45bc341228bcc0f2192040224 Jun 16 16:24:33.706461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:24:33.706461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:24:33.706461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 could not be found. Jun 16 16:24:33.706461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '17331aa3-ceef-4afb-9a61-a7bc981e5fa4'} Jun 16 16:24:33.707371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:24:33.707371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:33.707371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:24:33.707371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:24:33.707371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:24:33.707371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:24:33.707371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:24:33.707371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:24:33.707371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:24:33.707371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:24:33.707371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 could not be found. Jun 16 16:24:33.707371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:33.707371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:33.707371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:33.707371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:33.707371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:33.707371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:33.707371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:24:33.707371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:24:33.707371 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:24:33.708814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:24:33.708814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:24:33.708814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:24:33.708814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:24:33.708814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:24:33.708814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:24:33.708814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:24:33.708814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:24:33.708814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:24:33.708814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 could not be found. Jun 16 16:24:33.708814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:33.708814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:33.708814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:33.708814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:33.708814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:33.708814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:33.708814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:24:33.708814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:24:33.708814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 could not be found. Jun 16 16:24:33.708814 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:33.710317 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fbf45e0f-5bc1-48ce-8d7f-51d1f9dd9454 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Returning 404 to user: Instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:24:33.710317 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fbf45e0f-5bc1-48ce-8d7f-51d1f9dd9454 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "DELETE /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 404 len: 111 microversion: 2.1 time: 0.029395 Jun 16 16:24:33.710317 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 571/1142] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:24:33 2022] DELETE /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:24:33.714601 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-19661805-bff4-4b49-88da-c59b11420a4b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:33.715210 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-19661805-bff4-4b49-88da-c59b11420a4b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 17331aa3-ceef-4afb-9a61-a7bc981e5fa4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:33.722515 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-19661805-bff4-4b49-88da-c59b11420a4b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:33.722955 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-19661805-bff4-4b49-88da-c59b11420a4b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:33.723709 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-19661805-bff4-4b49-88da-c59b11420a4b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:33.724139 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-19661805-bff4-4b49-88da-c59b11420a4b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:33.737106 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-19661805-bff4-4b49-88da-c59b11420a4b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] HTTP exception thrown: Instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 could not be found. Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-19661805-bff4-4b49-88da-c59b11420a4b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Request method failure captured: Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 HTTP/1.1 Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1Z8eNcA8LvE_QGupE8IwZgqoLdb4bdar2JFxF-sM8vVrpRiD1EIWMp99ewnT5la5EmpgmBAQZOsVfs3XmSmDWWlPn9Df8pyp8HGhxHfE9ShSTZ5F3NEdcePS6LELsIFGFBpMHeDDC0nVbCEOCxMglGuS8woh2jjuJT6Oy7NXlIFCC8 Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:24:33.738641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:24:33.740197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c1cdf363c2e44af5b0d8cd748c58235b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:24:33.740197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:33.740197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:24:33.740197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:33.740197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:24:33.740197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:24:33.740197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:24:33.740197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: bfbcc9b45bc341228bcc0f2192040224 Jun 16 16:24:33.740197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:24:33.740197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:24:33.740197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 could not be found. Jun 16 16:24:33.740197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': '17331aa3-ceef-4afb-9a61-a7bc981e5fa4'} Jun 16 16:24:33.741422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:24:33.741422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:33.741422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:24:33.741422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:24:33.741422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:24:33.741422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:24:33.741422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:24:33.741422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:24:33.741422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:24:33.741422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:24:33.741422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 could not be found. Jun 16 16:24:33.741422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:33.741422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:33.741422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:33.741422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:33.741422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:33.741422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:33.741422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:24:33.741422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:24:33.741422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:24:33.742917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:24:33.742917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:24:33.742917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:24:33.742917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:24:33.742917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:24:33.742917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:24:33.742917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:24:33.742917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 could not be found. Jun 16 16:24:33.742917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:33.742917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:33.742917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:33.742917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:33.742917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:33.742917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:33.742917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:24:33.742917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:24:33.742917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 could not be found. Jun 16 16:24:33.742917 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:33.744452 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-19661805-bff4-4b49-88da-c59b11420a4b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Returning 404 to user: Instance 17331aa3-ceef-4afb-9a61-a7bc981e5fa4 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:24:33.744452 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-19661805-bff4-4b49-88da-c59b11420a4b tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4" status: 404 len: 111 microversion: 2.1 time: 0.029139 Jun 16 16:24:33.744452 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 572/1143] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:33 2022] GET /compute/v2.1/servers/17331aa3-ceef-4afb-9a61-a7bc981e5fa4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:24:33.748516 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-77b99e95-c265-4200-b236-0e8ec28004c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:33.749019 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-77b99e95-c265-4200-b236-0e8ec28004c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:33.755624 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-77b99e95-c265-4200-b236-0e8ec28004c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:33.756072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-77b99e95-c265-4200-b236-0e8ec28004c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:33.756836 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-77b99e95-c265-4200-b236-0e8ec28004c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:33.757275 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-77b99e95-c265-4200-b236-0e8ec28004c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:33.773040 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-77b99e95-c265-4200-b236-0e8ec28004c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] HTTP exception thrown: Instance 1331116f-adf2-4957-9d58-6436d217e73f could not be found. Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-77b99e95-c265-4200-b236-0e8ec28004c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Request method failure captured: Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: DELETE /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f HTTP/1.1 Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1Z8eNcA8LvE_QGupE8IwZgqoLdb4bdar2JFxF-sM8vVrpRiD1EIWMp99ewnT5la5EmpgmBAQZOsVfs3XmSmDWWlPn9Df8pyp8HGhxHfE9ShSTZ5F3NEdcePS6LELsIFGFBpMHeDDC0nVbCEOCxMglGuS8woh2jjuJT6Oy7NXlIFCC8 Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:24:33.774585 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:24:33.776162 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c1cdf363c2e44af5b0d8cd748c58235b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:24:33.776162 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:33.776162 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:24:33.776162 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:33.776162 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:24:33.776162 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:24:33.776162 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:24:33.776162 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: bfbcc9b45bc341228bcc0f2192040224 Jun 16 16:24:33.776162 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:24:33.776162 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:24:33.776162 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance 1331116f-adf2-4957-9d58-6436d217e73f could not be found. Jun 16 16:24:33.776162 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '1331116f-adf2-4957-9d58-6436d217e73f'} Jun 16 16:24:33.777213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:24:33.777213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:33.777213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:24:33.777213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:24:33.777213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:24:33.777213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:24:33.777213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:24:33.777213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:24:33.777213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:24:33.777213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:24:33.777213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1331116f-adf2-4957-9d58-6436d217e73f could not be found. Jun 16 16:24:33.777213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:33.777213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:33.777213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:33.777213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:33.777213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:33.777213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:33.777213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:24:33.777213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:24:33.777213 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:24:33.778722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:24:33.778722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:24:33.778722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:24:33.778722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:24:33.778722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:24:33.778722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:24:33.778722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:24:33.778722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:24:33.778722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:24:33.778722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1331116f-adf2-4957-9d58-6436d217e73f could not be found. Jun 16 16:24:33.778722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:33.778722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:33.778722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:33.778722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:33.778722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:33.778722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:33.778722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:24:33.778722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:24:33.778722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1331116f-adf2-4957-9d58-6436d217e73f could not be found. Jun 16 16:24:33.778722 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:33.780316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-77b99e95-c265-4200-b236-0e8ec28004c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Returning 404 to user: Instance 1331116f-adf2-4957-9d58-6436d217e73f could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:24:33.780316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-77b99e95-c265-4200-b236-0e8ec28004c8 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 404 len: 111 microversion: 2.1 time: 0.031484 Jun 16 16:24:33.780316 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 572/1144] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:24:33 2022] DELETE /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:24:33.784260 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1396cf71-8cb8-4ea4-914d-7c236c75ead1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:33.784869 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1396cf71-8cb8-4ea4-914d-7c236c75ead1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 1331116f-adf2-4957-9d58-6436d217e73f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:33.791045 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1396cf71-8cb8-4ea4-914d-7c236c75ead1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:33.791496 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1396cf71-8cb8-4ea4-914d-7c236c75ead1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:33.792251 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1396cf71-8cb8-4ea4-914d-7c236c75ead1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:33.792682 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1396cf71-8cb8-4ea4-914d-7c236c75ead1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:33.805950 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-1396cf71-8cb8-4ea4-914d-7c236c75ead1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] HTTP exception thrown: Instance 1331116f-adf2-4957-9d58-6436d217e73f could not be found. Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1396cf71-8cb8-4ea4-914d-7c236c75ead1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Request method failure captured: Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f HTTP/1.1 Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1Z8eNcA8LvE_QGupE8IwZgqoLdb4bdar2JFxF-sM8vVrpRiD1EIWMp99ewnT5la5EmpgmBAQZOsVfs3XmSmDWWlPn9Df8pyp8HGhxHfE9ShSTZ5F3NEdcePS6LELsIFGFBpMHeDDC0nVbCEOCxMglGuS8woh2jjuJT6Oy7NXlIFCC8 Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:24:33.807451 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:24:33.808991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c1cdf363c2e44af5b0d8cd748c58235b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:24:33.808991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:33.808991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:24:33.808991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:33.808991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:24:33.808991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:24:33.808991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:24:33.808991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: bfbcc9b45bc341228bcc0f2192040224 Jun 16 16:24:33.808991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:24:33.808991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:24:33.808991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Instance 1331116f-adf2-4957-9d58-6436d217e73f could not be found. Jun 16 16:24:33.808991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': '1331116f-adf2-4957-9d58-6436d217e73f'} Jun 16 16:24:33.810055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:24:33.810055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:33.810055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:24:33.810055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:24:33.810055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:24:33.810055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:24:33.810055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:24:33.810055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:24:33.810055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:24:33.810055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:24:33.810055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1331116f-adf2-4957-9d58-6436d217e73f could not be found. Jun 16 16:24:33.810055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:33.810055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:33.810055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:33.810055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:33.810055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:33.810055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:33.810055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:24:33.810055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:24:33.810055 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:24:33.811530 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:24:33.811530 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:24:33.811530 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:24:33.811530 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:24:33.811530 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:24:33.811530 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:24:33.811530 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:24:33.811530 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1331116f-adf2-4957-9d58-6436d217e73f could not be found. Jun 16 16:24:33.811530 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:33.811530 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:33.811530 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:33.811530 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:33.811530 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:33.811530 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:33.811530 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:24:33.811530 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:24:33.811530 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1331116f-adf2-4957-9d58-6436d217e73f could not be found. Jun 16 16:24:33.811530 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:33.813175 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1396cf71-8cb8-4ea4-914d-7c236c75ead1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Returning 404 to user: Instance 1331116f-adf2-4957-9d58-6436d217e73f could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:24:33.813175 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1396cf71-8cb8-4ea4-914d-7c236c75ead1 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f" status: 404 len: 111 microversion: 2.1 time: 0.028472 Jun 16 16:24:33.813175 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 573/1145] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:33 2022] GET /compute/v2.1/servers/1331116f-adf2-4957-9d58-6436d217e73f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:24:33.856997 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7a04c65f-fc29-4750-af97-0b9658385b4c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:33.857743 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7a04c65f-fc29-4750-af97-0b9658385b4c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:33.870407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7a04c65f-fc29-4750-af97-0b9658385b4c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:33.870864 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7a04c65f-fc29-4750-af97-0b9658385b4c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:33.871660 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7a04c65f-fc29-4750-af97-0b9658385b4c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:33.872204 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7a04c65f-fc29-4750-af97-0b9658385b4c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:34.016442 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7a04c65f-fc29-4750-af97-0b9658385b4c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:34.025047 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7a04c65f-fc29-4750-af97-0b9658385b4c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:34.026559 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7a04c65f-fc29-4750-af97-0b9658385b4c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:34.027696 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7a04c65f-fc29-4750-af97-0b9658385b4c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1724 microversion: 2.20 time: 0.175299 Jun 16 16:24:34.028248 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 573/1146] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:33 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:24:34.945043 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d889ee6f-c648-4e0f-a13e-42d63314b2e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:34.945554 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d889ee6f-c648-4e0f-a13e-42d63314b2e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:34.951983 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d889ee6f-c648-4e0f-a13e-42d63314b2e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:34.952446 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d889ee6f-c648-4e0f-a13e-42d63314b2e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:34.953193 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d889ee6f-c648-4e0f-a13e-42d63314b2e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:34.953635 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d889ee6f-c648-4e0f-a13e-42d63314b2e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:34.969208 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-d889ee6f-c648-4e0f-a13e-42d63314b2e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] HTTP exception thrown: Instance 6776a1f2-1043-4048-99e7-cdc91959fe40 could not be found. Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d889ee6f-c648-4e0f-a13e-42d63314b2e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Request method failure captured: Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: DELETE /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 HTTP/1.1 Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1Z8eNcA8LvE_QGupE8IwZgqoLdb4bdar2JFxF-sM8vVrpRiD1EIWMp99ewnT5la5EmpgmBAQZOsVfs3XmSmDWWlPn9Df8pyp8HGhxHfE9ShSTZ5F3NEdcePS6LELsIFGFBpMHeDDC0nVbCEOCxMglGuS8woh2jjuJT6Oy7NXlIFCC8 Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:24:34.970792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:24:34.973278 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c1cdf363c2e44af5b0d8cd748c58235b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:24:34.973278 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:34.973278 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:24:34.973278 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:34.973278 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:24:34.973278 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:24:34.973278 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:24:34.973278 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: bfbcc9b45bc341228bcc0f2192040224 Jun 16 16:24:34.973278 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:24:34.973278 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:24:34.973278 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Instance 6776a1f2-1043-4048-99e7-cdc91959fe40 could not be found. Jun 16 16:24:34.973278 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': '6776a1f2-1043-4048-99e7-cdc91959fe40'} Jun 16 16:24:34.974187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:24:34.974187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:34.974187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:24:34.974187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:24:34.974187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:24:34.974187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:24:34.974187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:24:34.974187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:24:34.974187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:24:34.974187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:24:34.974187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6776a1f2-1043-4048-99e7-cdc91959fe40 could not be found. Jun 16 16:24:34.974187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:34.974187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:34.974187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:34.974187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:34.974187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:34.974187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:34.974187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:24:34.974187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:24:34.974187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:24:34.975546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:24:34.975546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:24:34.975546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:24:34.975546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:24:34.975546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:24:34.975546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:24:34.975546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:24:34.975546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:24:34.975546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:24:34.975546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6776a1f2-1043-4048-99e7-cdc91959fe40 could not be found. Jun 16 16:24:34.975546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:34.975546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:34.975546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:34.975546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:34.975546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:34.975546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:34.975546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:24:34.975546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:24:34.975546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6776a1f2-1043-4048-99e7-cdc91959fe40 could not be found. Jun 16 16:24:34.975546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:34.976923 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d889ee6f-c648-4e0f-a13e-42d63314b2e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Returning 404 to user: Instance 6776a1f2-1043-4048-99e7-cdc91959fe40 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:24:34.976923 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d889ee6f-c648-4e0f-a13e-42d63314b2e3 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 404 len: 111 microversion: 2.1 time: 0.031857 Jun 16 16:24:34.976923 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 574/1147] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:24:34 2022] DELETE /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:24:34.981746 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-14abfd1b-b000-48a3-af94-baf79fdd9311 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:34.982394 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-14abfd1b-b000-48a3-af94-baf79fdd9311 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] [instance: 6776a1f2-1043-4048-99e7-cdc91959fe40] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:34.989393 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-14abfd1b-b000-48a3-af94-baf79fdd9311 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:34.989930 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-14abfd1b-b000-48a3-af94-baf79fdd9311 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:34.990681 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-14abfd1b-b000-48a3-af94-baf79fdd9311 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:34.991111 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-14abfd1b-b000-48a3-af94-baf79fdd9311 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:35.004445 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-14abfd1b-b000-48a3-af94-baf79fdd9311 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] HTTP exception thrown: Instance 6776a1f2-1043-4048-99e7-cdc91959fe40 could not be found. Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-14abfd1b-b000-48a3-af94-baf79fdd9311 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Request method failure captured: Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 HTTP/1.1 Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1Z8eNcA8LvE_QGupE8IwZgqoLdb4bdar2JFxF-sM8vVrpRiD1EIWMp99ewnT5la5EmpgmBAQZOsVfs3XmSmDWWlPn9Df8pyp8HGhxHfE9ShSTZ5F3NEdcePS6LELsIFGFBpMHeDDC0nVbCEOCxMglGuS8woh2jjuJT6Oy7NXlIFCC8 Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:24:35.006008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:24:35.007651 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c1cdf363c2e44af5b0d8cd748c58235b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c1cdf363c2e44af5b0d8cd748c58235b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:24:35.007651 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:35.007651 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: c1cdf363c2e44af5b0d8cd748c58235b Jun 16 16:24:35.007651 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-326636394 Jun 16 16:24:35.007651 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:24:35.007651 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:24:35.007651 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:24:35.007651 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: bfbcc9b45bc341228bcc0f2192040224 Jun 16 16:24:35.007651 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeNegativeTest-326636394-project Jun 16 16:24:35.007651 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:24:35.007651 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance 6776a1f2-1043-4048-99e7-cdc91959fe40 could not be found. Jun 16 16:24:35.007651 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '6776a1f2-1043-4048-99e7-cdc91959fe40'} Jun 16 16:24:35.008569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:24:35.008569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:35.008569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:24:35.008569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:24:35.008569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:24:35.008569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:24:35.008569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:24:35.008569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:24:35.008569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:24:35.008569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:24:35.008569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6776a1f2-1043-4048-99e7-cdc91959fe40 could not be found. Jun 16 16:24:35.008569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:35.008569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:35.008569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:35.008569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:35.008569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:35.008569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:35.008569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:24:35.008569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:24:35.008569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:24:35.010062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:24:35.010062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:24:35.010062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:24:35.010062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:24:35.010062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:24:35.010062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:24:35.010062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:24:35.010062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6776a1f2-1043-4048-99e7-cdc91959fe40 could not be found. Jun 16 16:24:35.010062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:35.010062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:35.010062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:35.010062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:35.010062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:35.010062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:35.010062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:24:35.010062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:24:35.010062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6776a1f2-1043-4048-99e7-cdc91959fe40 could not be found. Jun 16 16:24:35.010062 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:35.011263 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-14abfd1b-b000-48a3-af94-baf79fdd9311 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] Returning 404 to user: Instance 6776a1f2-1043-4048-99e7-cdc91959fe40 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:24:35.011263 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-14abfd1b-b000-48a3-af94-baf79fdd9311 tempest-AttachVolumeNegativeTest-326636394 tempest-AttachVolumeNegativeTest-326636394-project] 10.222.0.88 "GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40" status: 404 len: 111 microversion: 2.1 time: 0.029809 Jun 16 16:24:35.011263 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 574/1148] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:24:34 2022] GET /compute/v2.1/servers/6776a1f2-1043-4048-99e7-cdc91959fe40 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:24:35.045907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a0adb499-49b8-4421-8f06-05ebd141e213 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:35.046808 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a0adb499-49b8-4421-8f06-05ebd141e213 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:35.053464 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a0adb499-49b8-4421-8f06-05ebd141e213 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:35.054281 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a0adb499-49b8-4421-8f06-05ebd141e213 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:35.055210 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a0adb499-49b8-4421-8f06-05ebd141e213 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:35.055812 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a0adb499-49b8-4421-8f06-05ebd141e213 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:35.137023 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a0adb499-49b8-4421-8f06-05ebd141e213 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:35.147571 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a0adb499-49b8-4421-8f06-05ebd141e213 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:35.149082 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a0adb499-49b8-4421-8f06-05ebd141e213 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46445560ea7e496fa6c9c2e7c9a5b747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbfb390720a54a4eb35c80b0d1a1f16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:24:35.150396 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a0adb499-49b8-4421-8f06-05ebd141e213 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 200 len: 1657 microversion: 2.20 time: 0.108433 Jun 16 16:24:35.150947 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 575/1149] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:35 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 1657 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:24:35.556766 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-b0cca1f1-9cce-4919-9719-10bc6747547d req-642578b2-2dbd-4ab9-bd5f-6f1c593ea784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f151b6-bfce-4c42-932f-7be72f7da4b4", "name": "network-vif-deleted", "tag": "44d3a737-8fd0-480a-b4eb-2bc5eb327a3f"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:24:35.566900 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-b0cca1f1-9cce-4919-9719-10bc6747547d req-642578b2-2dbd-4ab9-bd5f-6f1c593ea784 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:35.567750 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-b0cca1f1-9cce-4919-9719-10bc6747547d req-642578b2-2dbd-4ab9-bd5f-6f1c593ea784 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:35.582801 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-b0cca1f1-9cce-4919-9719-10bc6747547d req-642578b2-2dbd-4ab9-bd5f-6f1c593ea784 service nova] Creating event network-vif-deleted:44d3a737-8fd0-480a-b4eb-2bc5eb327a3f for instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 on hv-cinder-83735 Jun 16 16:24:35.589708 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-b0cca1f1-9cce-4919-9719-10bc6747547d req-642578b2-2dbd-4ab9-bd5f-6f1c593ea784 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039634 Jun 16 16:24:35.590746 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 575/1150] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:24:36.169661 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-bc59fe76-e217-4dc0-a89b-d6a56a963d64 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:36.170472 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-bc59fe76-e217-4dc0-a89b-d6a56a963d64 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:36.178457 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bc59fe76-e217-4dc0-a89b-d6a56a963d64 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:36.179048 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bc59fe76-e217-4dc0-a89b-d6a56a963d64 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:36.180125 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bc59fe76-e217-4dc0-a89b-d6a56a963d64 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:36.180948 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bc59fe76-e217-4dc0-a89b-d6a56a963d64 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:36.196532 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-bc59fe76-e217-4dc0-a89b-d6a56a963d64 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] HTTP exception thrown: Instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 could not be found. Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-bc59fe76-e217-4dc0-a89b-d6a56a963d64 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Request method failure captured: Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 HTTP/1.1 Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1Z1-ipPk7le3oKBdhVjxYdBW03I33ZeyQfIYuNhvWm5TPt4-KR2Bi125tVaJEqjaogWKXHBhrrXughZ7tvdeK1liMiSY5sLtd5mFE2fpKEUug90pw-lBCz8rGyNxfiklySFDtWU70CcXtuDLLUrVpLetQL3OTRdCxCCA9r7l_AgQT4 Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: dbfb390720a54a4eb35c80b0d1a1f16b Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-927768562 Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:24:36.199204 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:24:36.200703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dbfb390720a54a4eb35c80b0d1a1f16b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dbfb390720a54a4eb35c80b0d1a1f16b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_dbfb390720a54a4eb35c80b0d1a1f16b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/dbfb390720a54a4eb35c80b0d1a1f16b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:24:36.200703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeShelveTestJSON-927768562 Jun 16 16:24:36.200703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: dbfb390720a54a4eb35c80b0d1a1f16b Jun 16 16:24:36.200703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-927768562 Jun 16 16:24:36.200703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeShelveTestJSON-927768562-project Jun 16 16:24:36.200703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:24:36.200703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:24:36.200703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: 46445560ea7e496fa6c9c2e7c9a5b747 Jun 16 16:24:36.200703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeShelveTestJSON-927768562-project Jun 16 16:24:36.200703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:24:36.200703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 could not be found. Jun 16 16:24:36.200703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': '38f151b6-bfce-4c42-932f-7be72f7da4b4'} Jun 16 16:24:36.202136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:24:36.202136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:36.202136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:24:36.202136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:24:36.202136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:24:36.202136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:24:36.202136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:24:36.202136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:24:36.202136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:24:36.202136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:24:36.202136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 could not be found. Jun 16 16:24:36.202136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:36.202136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:36.202136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:36.202136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:36.202136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:36.202136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:36.202136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:24:36.202136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:24:36.202136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:24:36.203389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:24:36.203389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:24:36.203389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:24:36.203389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:24:36.203389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:24:36.203389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:24:36.203389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:24:36.203389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 could not be found. Jun 16 16:24:36.203389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:36.203389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:36.203389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:36.203389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:36.203389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:36.203389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:36.203389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:24:36.203389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:24:36.203389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 could not be found. Jun 16 16:24:36.203389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:36.206359 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-bc59fe76-e217-4dc0-a89b-d6a56a963d64 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Returning 404 to user: Instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:24:36.207385 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-bc59fe76-e217-4dc0-a89b-d6a56a963d64 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 404 len: 111 microversion: 2.20 time: 0.041987 Jun 16 16:24:36.208385 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 576/1151] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:36 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:24:36.218023 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c190e9a5-0be1-45c2-879f-5782e01c7568 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '.version_select at 0x7f6f0d1fb040>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:36.240199 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c190e9a5-0be1-45c2-879f-5782e01c7568 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1628242834" status: 204 len: 0 microversion: 2.20 time: 0.027098 Jun 16 16:24:36.244388 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 576/1152] 10.222.0.88 () {60 vars in 1261 bytes} [Thu Jun 16 16:24:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1628242834 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 16:24:38.148223 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c5f186e3-a261-4447-b068-3b99b4ee2c2c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:38.148720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c5f186e3-a261-4447-b068-3b99b4ee2c2c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:38.155905 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c5f186e3-a261-4447-b068-3b99b4ee2c2c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:38.156359 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c5f186e3-a261-4447-b068-3b99b4ee2c2c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:38.157136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c5f186e3-a261-4447-b068-3b99b4ee2c2c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:38.157575 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c5f186e3-a261-4447-b068-3b99b4ee2c2c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:38.173443 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-c5f186e3-a261-4447-b068-3b99b4ee2c2c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] HTTP exception thrown: Instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 could not be found. Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c5f186e3-a261-4447-b068-3b99b4ee2c2c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Request method failure captured: Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: DELETE /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 HTTP/1.1 Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1Z1-ipPk7le3oKBdhVjxYdBW03I33ZeyQfIYuNhvWm5TPt4-KR2Bi125tVaJEqjaogWKXHBhrrXughZ7tvdeK1liMiSY5sLtd5mFE2fpKEUug90pw-lBCz8rGyNxfiklySFDtWU70CcXtuDLLUrVpLetQL3OTRdCxCCA9r7l_AgQT4 Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: dbfb390720a54a4eb35c80b0d1a1f16b Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-927768562 Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:24:38.175340 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:24:38.177318 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dbfb390720a54a4eb35c80b0d1a1f16b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dbfb390720a54a4eb35c80b0d1a1f16b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_dbfb390720a54a4eb35c80b0d1a1f16b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/dbfb390720a54a4eb35c80b0d1a1f16b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:24:38.177318 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeShelveTestJSON-927768562 Jun 16 16:24:38.177318 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: dbfb390720a54a4eb35c80b0d1a1f16b Jun 16 16:24:38.177318 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-927768562 Jun 16 16:24:38.177318 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeShelveTestJSON-927768562-project Jun 16 16:24:38.177318 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:24:38.177318 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:24:38.177318 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: 46445560ea7e496fa6c9c2e7c9a5b747 Jun 16 16:24:38.177318 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeShelveTestJSON-927768562-project Jun 16 16:24:38.177318 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:24:38.177318 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 could not be found. Jun 16 16:24:38.177318 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': '38f151b6-bfce-4c42-932f-7be72f7da4b4'} Jun 16 16:24:38.178432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:24:38.178432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:38.178432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:24:38.178432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:24:38.178432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:24:38.178432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:24:38.178432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:24:38.178432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:24:38.178432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:24:38.178432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:24:38.178432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 could not be found. Jun 16 16:24:38.178432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:38.178432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:38.178432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:38.178432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:38.178432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:38.178432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:38.178432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:24:38.178432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:24:38.178432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:24:38.179909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:24:38.179909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:24:38.179909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:24:38.179909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:24:38.179909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:24:38.179909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:24:38.179909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:24:38.179909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:24:38.179909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:24:38.179909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 could not be found. Jun 16 16:24:38.179909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:38.179909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:38.179909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:38.179909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:38.179909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:38.179909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:38.179909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:24:38.179909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:24:38.179909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 could not be found. Jun 16 16:24:38.179909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:38.182229 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c5f186e3-a261-4447-b068-3b99b4ee2c2c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Returning 404 to user: Instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:24:38.182229 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c5f186e3-a261-4447-b068-3b99b4ee2c2c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "DELETE /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 404 len: 111 microversion: 2.20 time: 0.032485 Jun 16 16:24:38.182229 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 577/1153] 10.222.0.88 () {60 vars in 1279 bytes} [Thu Jun 16 16:24:38 2022] DELETE /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:24:38.185318 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-10f94386-6d74-4ee6-9b83-2d2ad1babba6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:38.186567 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-10f94386-6d74-4ee6-9b83-2d2ad1babba6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 38f151b6-bfce-4c42-932f-7be72f7da4b4] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:38.194000 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10f94386-6d74-4ee6-9b83-2d2ad1babba6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:38.194831 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10f94386-6d74-4ee6-9b83-2d2ad1babba6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:38.195610 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10f94386-6d74-4ee6-9b83-2d2ad1babba6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:38.196230 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-10f94386-6d74-4ee6-9b83-2d2ad1babba6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:38.216842 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-10f94386-6d74-4ee6-9b83-2d2ad1babba6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] HTTP exception thrown: Instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 could not be found. Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-10f94386-6d74-4ee6-9b83-2d2ad1babba6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Request method failure captured: Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 HTTP/1.1 Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1Z1-ipPk7le3oKBdhVjxYdBW03I33ZeyQfIYuNhvWm5TPt4-KR2Bi125tVaJEqjaogWKXHBhrrXughZ7tvdeK1liMiSY5sLtd5mFE2fpKEUug90pw-lBCz8rGyNxfiklySFDtWU70CcXtuDLLUrVpLetQL3OTRdCxCCA9r7l_AgQT4 Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: dbfb390720a54a4eb35c80b0d1a1f16b Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-927768562 Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:24:38.218721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:24:38.220429 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dbfb390720a54a4eb35c80b0d1a1f16b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dbfb390720a54a4eb35c80b0d1a1f16b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_dbfb390720a54a4eb35c80b0d1a1f16b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/dbfb390720a54a4eb35c80b0d1a1f16b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:24:38.220429 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeShelveTestJSON-927768562 Jun 16 16:24:38.220429 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: dbfb390720a54a4eb35c80b0d1a1f16b Jun 16 16:24:38.220429 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-927768562 Jun 16 16:24:38.220429 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeShelveTestJSON-927768562-project Jun 16 16:24:38.220429 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:24:38.220429 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:24:38.220429 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: 46445560ea7e496fa6c9c2e7c9a5b747 Jun 16 16:24:38.220429 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeShelveTestJSON-927768562-project Jun 16 16:24:38.220429 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:24:38.220429 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 could not be found. Jun 16 16:24:38.220429 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '38f151b6-bfce-4c42-932f-7be72f7da4b4'} Jun 16 16:24:38.222385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:24:38.222385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:38.222385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:24:38.222385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:24:38.222385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:24:38.222385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:24:38.222385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:24:38.222385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:24:38.222385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:24:38.222385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:24:38.222385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 could not be found. Jun 16 16:24:38.222385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:38.222385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:38.222385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:38.222385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:38.222385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:38.222385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:38.222385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:24:38.222385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:24:38.222385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:24:38.223680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:24:38.223680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:24:38.223680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:24:38.223680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:24:38.223680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:24:38.223680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:24:38.223680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:24:38.223680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 could not be found. Jun 16 16:24:38.223680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:38.223680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:38.223680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:38.223680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:38.223680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:38.223680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:38.223680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:24:38.223680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:24:38.223680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 could not be found. Jun 16 16:24:38.223680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:38.224892 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-10f94386-6d74-4ee6-9b83-2d2ad1babba6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Returning 404 to user: Instance 38f151b6-bfce-4c42-932f-7be72f7da4b4 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:24:38.224892 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-10f94386-6d74-4ee6-9b83-2d2ad1babba6 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4" status: 404 len: 111 microversion: 2.20 time: 0.038708 Jun 16 16:24:38.224892 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 577/1154] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:38 2022] GET /compute/v2.1/servers/38f151b6-bfce-4c42-932f-7be72f7da4b4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:24:39.356920 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-531bc339-7c9a-49f3-8494-80fdf5515807 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:39.357495 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-531bc339-7c9a-49f3-8494-80fdf5515807 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:39.364770 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-531bc339-7c9a-49f3-8494-80fdf5515807 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:39.365302 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-531bc339-7c9a-49f3-8494-80fdf5515807 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:39.366112 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-531bc339-7c9a-49f3-8494-80fdf5515807 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:39.366658 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-531bc339-7c9a-49f3-8494-80fdf5515807 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:39.381466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-531bc339-7c9a-49f3-8494-80fdf5515807 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] HTTP exception thrown: Instance 31998833-f554-4e9e-8215-6694a9d01970 could not be found. Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-531bc339-7c9a-49f3-8494-80fdf5515807 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Request method failure captured: Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: DELETE /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 HTTP/1.1 Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1Z1-ipPk7le3oKBdhVjxYdBW03I33ZeyQfIYuNhvWm5TPt4-KR2Bi125tVaJEqjaogWKXHBhrrXughZ7tvdeK1liMiSY5sLtd5mFE2fpKEUug90pw-lBCz8rGyNxfiklySFDtWU70CcXtuDLLUrVpLetQL3OTRdCxCCA9r7l_AgQT4 Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: dbfb390720a54a4eb35c80b0d1a1f16b Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-927768562 Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:24:39.383031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:24:39.384529 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dbfb390720a54a4eb35c80b0d1a1f16b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dbfb390720a54a4eb35c80b0d1a1f16b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_dbfb390720a54a4eb35c80b0d1a1f16b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/dbfb390720a54a4eb35c80b0d1a1f16b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:24:39.384529 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeShelveTestJSON-927768562 Jun 16 16:24:39.384529 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: dbfb390720a54a4eb35c80b0d1a1f16b Jun 16 16:24:39.384529 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-927768562 Jun 16 16:24:39.384529 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeShelveTestJSON-927768562-project Jun 16 16:24:39.384529 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:24:39.384529 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:24:39.384529 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: 46445560ea7e496fa6c9c2e7c9a5b747 Jun 16 16:24:39.384529 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeShelveTestJSON-927768562-project Jun 16 16:24:39.384529 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:24:39.384529 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Instance 31998833-f554-4e9e-8215-6694a9d01970 could not be found. Jun 16 16:24:39.384529 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': '31998833-f554-4e9e-8215-6694a9d01970'} Jun 16 16:24:39.385272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:24:39.385272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:39.385272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:24:39.385272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:24:39.385272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:24:39.385272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:24:39.385272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:24:39.385272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:24:39.385272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:24:39.385272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:24:39.385272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31998833-f554-4e9e-8215-6694a9d01970 could not be found. Jun 16 16:24:39.385272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:39.385272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:39.385272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:39.385272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:39.385272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:39.385272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:39.385272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:24:39.385272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:24:39.385272 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:24:39.387202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:24:39.387202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:24:39.387202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:24:39.387202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:24:39.387202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:24:39.387202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:24:39.387202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:24:39.387202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:24:39.387202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:24:39.387202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31998833-f554-4e9e-8215-6694a9d01970 could not be found. Jun 16 16:24:39.387202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:39.387202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:39.387202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:39.387202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:39.387202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:39.387202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:39.387202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:24:39.387202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:24:39.387202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31998833-f554-4e9e-8215-6694a9d01970 could not be found. Jun 16 16:24:39.387202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:24:39.389146 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-531bc339-7c9a-49f3-8494-80fdf5515807 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Returning 404 to user: Instance 31998833-f554-4e9e-8215-6694a9d01970 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:24:39.389146 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-531bc339-7c9a-49f3-8494-80fdf5515807 tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "DELETE /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 404 len: 111 microversion: 2.20 time: 0.031388 Jun 16 16:24:39.389146 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 578/1155] 10.222.0.88 () {60 vars in 1279 bytes} [Thu Jun 16 16:24:39 2022] DELETE /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:24:39.393394 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0ef9caa6-4199-4f0b-9b49-50cf3d9e628c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:39.394245 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0ef9caa6-4199-4f0b-9b49-50cf3d9e628c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] [instance: 31998833-f554-4e9e-8215-6694a9d01970] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:24:39.400408 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0ef9caa6-4199-4f0b-9b49-50cf3d9e628c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:39.400821 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0ef9caa6-4199-4f0b-9b49-50cf3d9e628c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:39.401592 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0ef9caa6-4199-4f0b-9b49-50cf3d9e628c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:24:39.402499 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0ef9caa6-4199-4f0b-9b49-50cf3d9e628c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:24:39.415940 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-0ef9caa6-4199-4f0b-9b49-50cf3d9e628c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] HTTP exception thrown: Instance 31998833-f554-4e9e-8215-6694a9d01970 could not be found. Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0ef9caa6-4199-4f0b-9b49-50cf3d9e628c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Request method failure captured: Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 HTTP/1.1 Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1Z1-ipPk7le3oKBdhVjxYdBW03I33ZeyQfIYuNhvWm5TPt4-KR2Bi125tVaJEqjaogWKXHBhrrXughZ7tvdeK1liMiSY5sLtd5mFE2fpKEUug90pw-lBCz8rGyNxfiklySFDtWU70CcXtuDLLUrVpLetQL3OTRdCxCCA9r7l_AgQT4 Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: dbfb390720a54a4eb35c80b0d1a1f16b Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-927768562 Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:24:39.417465 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:24:39.419214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dbfb390720a54a4eb35c80b0d1a1f16b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/dbfb390720a54a4eb35c80b0d1a1f16b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_dbfb390720a54a4eb35c80b0d1a1f16b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/dbfb390720a54a4eb35c80b0d1a1f16b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:24:39.419214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeShelveTestJSON-927768562 Jun 16 16:24:39.419214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: dbfb390720a54a4eb35c80b0d1a1f16b Jun 16 16:24:39.419214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-927768562 Jun 16 16:24:39.419214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeShelveTestJSON-927768562-project Jun 16 16:24:39.419214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:24:39.419214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:24:39.419214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: 46445560ea7e496fa6c9c2e7c9a5b747 Jun 16 16:24:39.419214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeShelveTestJSON-927768562-project Jun 16 16:24:39.419214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:24:39.419214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance 31998833-f554-4e9e-8215-6694a9d01970 could not be found. Jun 16 16:24:39.419214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '31998833-f554-4e9e-8215-6694a9d01970'} Jun 16 16:24:39.424617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:24:39.424617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:39.424617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:24:39.424617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:24:39.424617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:24:39.424617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:24:39.424617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:24:39.424617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:24:39.424617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:24:39.424617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:24:39.424617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31998833-f554-4e9e-8215-6694a9d01970 could not be found. Jun 16 16:24:39.424617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:39.424617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:39.424617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:39.424617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:39.424617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:39.424617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:39.424617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:24:39.424617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:24:39.424617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:24:39.426305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:24:39.426305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:24:39.426305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:24:39.426305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:24:39.426305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:24:39.426305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:24:39.426305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:24:39.426305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31998833-f554-4e9e-8215-6694a9d01970 could not be found. Jun 16 16:24:39.426305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:39.426305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:24:39.426305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:39.426305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:24:39.426305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:24:39.426305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:24:39.426305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:24:39.426305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:24:39.426305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31998833-f554-4e9e-8215-6694a9d01970 could not be found. Jun 16 16:24:39.426305 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:24:39.427663 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0ef9caa6-4199-4f0b-9b49-50cf3d9e628c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] Returning 404 to user: Instance 31998833-f554-4e9e-8215-6694a9d01970 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:24:39.427663 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0ef9caa6-4199-4f0b-9b49-50cf3d9e628c tempest-AttachVolumeShelveTestJSON-927768562 tempest-AttachVolumeShelveTestJSON-927768562-project] 10.222.0.88 "GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970" status: 404 len: 111 microversion: 2.20 time: 0.029372 Jun 16 16:24:39.427663 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 578/1156] 10.222.0.88 () {60 vars in 1276 bytes} [Thu Jun 16 16:24:39 2022] GET /compute/v2.1/servers/31998833-f554-4e9e-8215-6694a9d01970 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:24:41.072057 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0625f0c0-65c0-47a8-931e-7f23f79d8f51 tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] Calling method '.version_select at 0x7f6f0dd805e0>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:41.121911 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0625f0c0-65c0-47a8-931e-7f23f79d8f51 tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/4757d655-0ff8-49fd-a90c-3bc7b2c5718d" status: 200 len: 351 microversion: 2.1 time: 0.053805 Jun 16 16:24:41.123531 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 579/1157] 10.222.0.88 () {58 vars in 1244 bytes} [Thu Jun 16 16:24:41 2022] GET /compute/v2.1/os-volumes/4757d655-0ff8-49fd-a90c-3bc7b2c5718d => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:24:42.486266 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-953223f0-17e6-462a-b9c7-80b007ba3ce3 tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] Calling method '.version_select at 0x7f6f0d1fb940>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:42.539165 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-953223f0-17e6-462a-b9c7-80b007ba3ce3 tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/1b795e28-2396-4548-ac23-36467ebb5cd1" status: 200 len: 350 microversion: 2.1 time: 0.057189 Jun 16 16:24:42.539775 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 579/1158] 10.222.0.88 () {58 vars in 1244 bytes} [Thu Jun 16 16:24:42 2022] GET /compute/v2.1/os-volumes/1b795e28-2396-4548-ac23-36467ebb5cd1 => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:24:43.944502 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-154cc969-615b-483d-8684-357dd1e1ca8c tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] Calling method '.version_select at 0x7f6f0d338790>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:43.993567 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-154cc969-615b-483d-8684-357dd1e1ca8c tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/ca38a528-9f2a-4a36-a7f8-e2fad887584d" status: 200 len: 350 microversion: 2.1 time: 0.053277 Jun 16 16:24:43.994171 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 580/1159] 10.222.0.88 () {58 vars in 1244 bytes} [Thu Jun 16 16:24:43 2022] GET /compute/v2.1/os-volumes/ca38a528-9f2a-4a36-a7f8-e2fad887584d => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:24:44.006186 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-842bf04f-9641-4ba8-b6b6-de0ddc409b18 tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] Calling method '.version_select at 0x7f6f0d1dd310>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:44.091834 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-842bf04f-9641-4ba8-b6b6-de0ddc409b18 tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] 10.222.0.88 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090241 Jun 16 16:24:44.092481 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 580/1160] 10.222.0.88 () {58 vars in 1133 bytes} [Thu Jun 16 16:24:44 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:44.105089 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6a1ba6aa-1a6f-4aec-b9e4-a907693daf45 tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] Calling method '.version_select at 0x7f6f0d0af820>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:44.188329 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6a1ba6aa-1a6f-4aec-b9e4-a907693daf45 tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] 10.222.0.88 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.086957 Jun 16 16:24:44.188984 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 581/1161] 10.222.0.88 () {58 vars in 1148 bytes} [Thu Jun 16 16:24:44 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:24:44.200397 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-01e8e040-fc33-4802-9eb6-6cfd99daf4b0 tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] Calling method '.version_select at 0x7f6f0d25a9d0>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:44.280523 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-01e8e040-fc33-4802-9eb6-6cfd99daf4b0 tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] 10.222.0.88 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.083882 Jun 16 16:24:44.281224 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 581/1162] 10.222.0.88 () {58 vars in 1133 bytes} [Thu Jun 16 16:24:44 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:44.292843 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a52a6a88-d868-4097-863d-dab71bf02177 tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] Calling method '.version_select at 0x7f6f0d0afc10>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:44.374826 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a52a6a88-d868-4097-863d-dab71bf02177 tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] 10.222.0.88 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085702 Jun 16 16:24:44.375387 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 582/1163] 10.222.0.88 () {58 vars in 1166 bytes} [Thu Jun 16 16:24:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:24:44.388044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-65318644-0e25-4278-bc6a-cc872ed63e2f tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] Calling method '.version_select at 0x7f6f0d289160>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:44.626253 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-65318644-0e25-4278-bc6a-cc872ed63e2f tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.241758 Jun 16 16:24:44.628074 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 582/1164] 10.222.0.88 () {58 vars in 1169 bytes} [Thu Jun 16 16:24:44 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:24:44.639696 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6944b066-ee47-4406-8733-5670ce2b8c36 tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] Calling method '.version_select at 0x7f6f0d042ca0>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:44.722017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6944b066-ee47-4406-8733-5670ce2b8c36 tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085810 Jun 16 16:24:44.722601 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 583/1165] 10.222.0.88 () {58 vars in 1154 bytes} [Thu Jun 16 16:24:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:24:44.733471 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-395dd7f4-731b-413c-a301-586ff1701255 tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] Calling method '.version_select at 0x7f6f1194e040>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:44.962615 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-395dd7f4-731b-413c-a301-586ff1701255 tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.232948 Jun 16 16:24:44.963185 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 583/1166] 10.222.0.88 () {58 vars in 1187 bytes} [Thu Jun 16 16:24:44 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:24:44.975838 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-69f06fad-a311-48e9-80b4-efc06c77facd tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] Calling method '.version_select at 0x7f6f0d3380d0>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:24:45.058553 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-69f06fad-a311-48e9-80b4-efc06c77facd tempest-VolumesTestJSON-718076832 tempest-VolumesTestJSON-718076832-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087753 Jun 16 16:24:45.059128 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 584/1167] 10.222.0.88 () {58 vars in 1154 bytes} [Thu Jun 16 16:24:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:22.738101 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:22.739294 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:22.743793 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9d948e15-3e73-4360-85ba-5c4812d70a36 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-323624590", "imageRef": "d2716dc1-3d4d-4f62-b0af-c38986f2a3aa", "flavorRef": "452", "networks": [{"uuid": "55b2b9aa-7687-4c75-bbb1-e15bb885a239"}]}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:25:22.801147 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.network.neutron [None req-9d948e15-3e73-4360-85ba-5c4812d70a36 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] validate_networks() for [('55b2b9aa-7687-4c75-bbb1-e15bb885a239', None, None, None, None, None)] {{(pid=117711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:25:23.229092 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-9d948e15-3e73-4360-85ba-5c4812d70a36 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Flavor limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:25:23.229509 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-9d948e15-3e73-4360-85ba-5c4812d70a36 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Image limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:25:23.230045 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-9d948e15-3e73-4360-85ba-5c4812d70a36 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Flavor pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:25:23.230454 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-9d948e15-3e73-4360-85ba-5c4812d70a36 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Image pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:25:23.230857 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-9d948e15-3e73-4360-85ba-5c4812d70a36 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:25:23.239742 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d948e15-3e73-4360-85ba-5c4812d70a36 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:23.240211 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d948e15-3e73-4360-85ba-5c4812d70a36 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:23.241032 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d948e15-3e73-4360-85ba-5c4812d70a36 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:23.241461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9d948e15-3e73-4360-85ba-5c4812d70a36 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:23.258405 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-9d948e15-3e73-4360-85ba-5c4812d70a36 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Getting quotas for project a4902d01c5044cad97843dd5f4742de9. Resources: {'ram', 'instances', 'cores'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:25:23.262298 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-9d948e15-3e73-4360-85ba-5c4812d70a36 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Getting quotas for user db1d1606f20a4807b52756f2169b5fe4 and project a4902d01c5044cad97843dd5f4742de9. Resources: {'ram', 'instances', 'cores'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:25:23.273982 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9d948e15-3e73-4360-85ba-5c4812d70a36 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Going to run 1 instances... {{(pid=117711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:25:23.276241 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9d948e15-3e73-4360-85ba-5c4812d70a36 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 9bafabf3-13ed-41be-901c-30e718386cd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2716dc1-3d4d-4f62-b0af-c38986f2a3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:25:23.322878 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9d948e15-3e73-4360-85ba-5c4812d70a36 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586193 Jun 16 16:25:23.323694 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 584/1168] 10.222.0.88 () {60 vars in 1146 bytes} [Thu Jun 16 16:25:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:25:23.331558 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:23.332296 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:23.336521 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0ea7cd33-d094-4462-8f7d-846826759770 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:23.337138 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0ea7cd33-d094-4462-8f7d-846826759770 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 9bafabf3-13ed-41be-901c-30e718386cd5] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:23.397884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-0ea7cd33-d094-4462-8f7d-846826759770 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:23.406475 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0ea7cd33-d094-4462-8f7d-846826759770 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5" status: 200 len: 1213 microversion: 2.1 time: 0.076424 Jun 16 16:25:23.407596 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 585/1169] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:23 2022] GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:24.425321 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6b5be43f-0c0d-40e0-948d-7285f5b4c1d7 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:24.426158 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6b5be43f-0c0d-40e0-948d-7285f5b4c1d7 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 9bafabf3-13ed-41be-901c-30e718386cd5] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:24.433758 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6b5be43f-0c0d-40e0-948d-7285f5b4c1d7 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:24.434701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6b5be43f-0c0d-40e0-948d-7285f5b4c1d7 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:24.435836 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6b5be43f-0c0d-40e0-948d-7285f5b4c1d7 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:24.436713 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6b5be43f-0c0d-40e0-948d-7285f5b4c1d7 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:24.524598 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6b5be43f-0c0d-40e0-948d-7285f5b4c1d7 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:24.533601 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6b5be43f-0c0d-40e0-948d-7285f5b4c1d7 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5" status: 200 len: 1271 microversion: 2.1 time: 0.113319 Jun 16 16:25:24.534197 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 585/1170] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:24 2022] GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5 => generated 1271 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:25.551807 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b44771d8-5edd-4248-81be-ee9ed8e6cf44 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:25.552417 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b44771d8-5edd-4248-81be-ee9ed8e6cf44 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 9bafabf3-13ed-41be-901c-30e718386cd5] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:25.558959 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b44771d8-5edd-4248-81be-ee9ed8e6cf44 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:25.559333 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b44771d8-5edd-4248-81be-ee9ed8e6cf44 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:25.560098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b44771d8-5edd-4248-81be-ee9ed8e6cf44 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:25.560736 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b44771d8-5edd-4248-81be-ee9ed8e6cf44 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:25.784074 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-45404e83-6d85-499f-8739-63d76d75da07 req-8f9d2941-d4dd-4e0e-9a99-55868234e220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bafabf3-13ed-41be-901c-30e718386cd5", "tag": "dec74a39-08d4-4c2a-a538-734af2b286ae"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:25:25.799064 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-45404e83-6d85-499f-8739-63d76d75da07 req-8f9d2941-d4dd-4e0e-9a99-55868234e220 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:25.799855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-45404e83-6d85-499f-8739-63d76d75da07 req-8f9d2941-d4dd-4e0e-9a99-55868234e220 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:25.815096 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b44771d8-5edd-4248-81be-ee9ed8e6cf44 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:25.815323 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-45404e83-6d85-499f-8739-63d76d75da07 req-8f9d2941-d4dd-4e0e-9a99-55868234e220 service nova] Creating event network-changed:dec74a39-08d4-4c2a-a538-734af2b286ae for instance 9bafabf3-13ed-41be-901c-30e718386cd5 on hv-cinder-83735 Jun 16 16:25:25.819783 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-45404e83-6d85-499f-8739-63d76d75da07 req-8f9d2941-d4dd-4e0e-9a99-55868234e220 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041167 Jun 16 16:25:25.820599 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 586/1171] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:25:25.825206 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b44771d8-5edd-4248-81be-ee9ed8e6cf44 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5" status: 200 len: 1313 microversion: 2.1 time: 0.277802 Jun 16 16:25:25.825797 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 586/1172] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:25 2022] GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:25:26.843344 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-8b487d97-8d32-4afb-b330-6f615a3b54e9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:26.844035 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-8b487d97-8d32-4afb-b330-6f615a3b54e9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 9bafabf3-13ed-41be-901c-30e718386cd5] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:26.850802 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8b487d97-8d32-4afb-b330-6f615a3b54e9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:26.851289 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8b487d97-8d32-4afb-b330-6f615a3b54e9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:26.852147 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8b487d97-8d32-4afb-b330-6f615a3b54e9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:26.852620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-8b487d97-8d32-4afb-b330-6f615a3b54e9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:27.237973 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-8b487d97-8d32-4afb-b330-6f615a3b54e9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:27.245425 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-8b487d97-8d32-4afb-b330-6f615a3b54e9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5" status: 200 len: 1313 microversion: 2.1 time: 0.406692 Jun 16 16:25:27.246051 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 587/1173] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:26 2022] GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5 => generated 1313 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:27.841956 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c95a8d29-bdc4-4c7b-8975-0b8860ea234b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:27.842526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c95a8d29-bdc4-4c7b-8975-0b8860ea234b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:27.849772 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c95a8d29-bdc4-4c7b-8975-0b8860ea234b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:27.850224 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c95a8d29-bdc4-4c7b-8975-0b8860ea234b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:27.850983 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c95a8d29-bdc4-4c7b-8975-0b8860ea234b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:27.851413 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c95a8d29-bdc4-4c7b-8975-0b8860ea234b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:27.932513 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-c95a8d29-bdc4-4c7b-8975-0b8860ea234b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lazy-loading 'services' on Instance uuid 3b0f7646-c731-405a-ac41-0e889b5fdb56 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:25:28.006375 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c95a8d29-bdc4-4c7b-8975-0b8860ea234b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56/os-volume_attachments/f58cd020-58e2-45de-95df-8e0bd23108c5" status: 202 len: 0 microversion: 2.1 time: 0.168584 Jun 16 16:25:28.006958 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 587/1174] 10.222.0.88 () {58 vars in 1415 bytes} [Thu Jun 16 16:25:27 2022] DELETE /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56/os-volume_attachments/f58cd020-58e2-45de-95df-8e0bd23108c5 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:25:28.262977 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-72b094bc-5333-48d8-bdd7-4876e27c051e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:28.263636 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-72b094bc-5333-48d8-bdd7-4876e27c051e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 9bafabf3-13ed-41be-901c-30e718386cd5] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:28.270526 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-72b094bc-5333-48d8-bdd7-4876e27c051e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:28.270964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-72b094bc-5333-48d8-bdd7-4876e27c051e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:28.271727 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-72b094bc-5333-48d8-bdd7-4876e27c051e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:28.272156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-72b094bc-5333-48d8-bdd7-4876e27c051e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:28.400037 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-72b094bc-5333-48d8-bdd7-4876e27c051e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:28.410352 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-72b094bc-5333-48d8-bdd7-4876e27c051e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5" status: 200 len: 1313 microversion: 2.1 time: 0.151069 Jun 16 16:25:28.411264 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 588/1175] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:28 2022] GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:29.429448 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4f455c06-2ee0-42dd-ac90-45cf0f1879c4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:29.431741 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4f455c06-2ee0-42dd-ac90-45cf0f1879c4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 9bafabf3-13ed-41be-901c-30e718386cd5] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:29.441937 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4f455c06-2ee0-42dd-ac90-45cf0f1879c4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:29.443494 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4f455c06-2ee0-42dd-ac90-45cf0f1879c4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:29.444909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4f455c06-2ee0-42dd-ac90-45cf0f1879c4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:29.445586 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4f455c06-2ee0-42dd-ac90-45cf0f1879c4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:29.607956 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-4f455c06-2ee0-42dd-ac90-45cf0f1879c4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:29.615863 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4f455c06-2ee0-42dd-ac90-45cf0f1879c4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5" status: 200 len: 1313 microversion: 2.1 time: 0.191644 Jun 16 16:25:29.616436 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 588/1176] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:29 2022] GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:30.632786 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-09a770cd-462e-42e5-be69-ee3ade333b34 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:30.633400 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-09a770cd-462e-42e5-be69-ee3ade333b34 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 9bafabf3-13ed-41be-901c-30e718386cd5] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:30.640642 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-09a770cd-462e-42e5-be69-ee3ade333b34 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:30.641096 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-09a770cd-462e-42e5-be69-ee3ade333b34 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:30.642136 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-09a770cd-462e-42e5-be69-ee3ade333b34 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:30.642334 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-09a770cd-462e-42e5-be69-ee3ade333b34 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:30.786299 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-09a770cd-462e-42e5-be69-ee3ade333b34 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:30.794289 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-09a770cd-462e-42e5-be69-ee3ade333b34 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5" status: 200 len: 1313 microversion: 2.1 time: 0.165475 Jun 16 16:25:30.794862 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 589/1177] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:30 2022] GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:31.235627 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b42c5d2b-9601-42e3-8c2b-42d0b4137156 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:25:31.242184 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b42c5d2b-9601-42e3-8c2b-42d0b4137156 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:31.242635 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b42c5d2b-9601-42e3-8c2b-42d0b4137156 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:31.305072 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b42c5d2b-9601-42e3-8c2b-42d0b4137156 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Going to try to stop instance {{(pid=117712) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 16:25:31.350614 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b42c5d2b-9601-42e3-8c2b-42d0b4137156 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "POST /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56/action" status: 202 len: 0 microversion: 2.1 time: 0.119244 Jun 16 16:25:31.351369 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 589/1178] 10.222.0.88 () {60 vars in 1277 bytes} [Thu Jun 16 16:25:31 2022] POST /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:25:31.359466 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-50b4d080-ec8e-4662-80f0-c4ec915a60e4 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:31.360087 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-50b4d080-ec8e-4662-80f0-c4ec915a60e4 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:31.366958 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-50b4d080-ec8e-4662-80f0-c4ec915a60e4 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:31.367419 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-50b4d080-ec8e-4662-80f0-c4ec915a60e4 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:31.368241 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-50b4d080-ec8e-4662-80f0-c4ec915a60e4 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:31.368898 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-50b4d080-ec8e-4662-80f0-c4ec915a60e4 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:31.511827 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-50b4d080-ec8e-4662-80f0-c4ec915a60e4 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:31.519943 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-50b4d080-ec8e-4662-80f0-c4ec915a60e4 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1677 microversion: 2.1 time: 0.164461 Jun 16 16:25:31.520509 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 590/1179] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:31 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:25:31.812936 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8224e63f-f662-4345-b1a4-5247e61895ec tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:31.813650 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8224e63f-f662-4345-b1a4-5247e61895ec tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 9bafabf3-13ed-41be-901c-30e718386cd5] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:31.820178 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8224e63f-f662-4345-b1a4-5247e61895ec tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:31.820626 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8224e63f-f662-4345-b1a4-5247e61895ec tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:31.821405 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8224e63f-f662-4345-b1a4-5247e61895ec tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:31.821883 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8224e63f-f662-4345-b1a4-5247e61895ec tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:31.957998 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8224e63f-f662-4345-b1a4-5247e61895ec tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:31.965274 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8224e63f-f662-4345-b1a4-5247e61895ec tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5" status: 200 len: 1313 microversion: 2.1 time: 0.156939 Jun 16 16:25:31.965861 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 590/1180] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:31 2022] GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:32.539753 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b5ef6657-13b5-4ee0-a074-96edc0662df3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:32.540358 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b5ef6657-13b5-4ee0-a074-96edc0662df3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:32.546503 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b5ef6657-13b5-4ee0-a074-96edc0662df3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:32.546953 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b5ef6657-13b5-4ee0-a074-96edc0662df3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:32.547713 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b5ef6657-13b5-4ee0-a074-96edc0662df3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:32.548145 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b5ef6657-13b5-4ee0-a074-96edc0662df3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:32.691532 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b5ef6657-13b5-4ee0-a074-96edc0662df3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:32.702072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b5ef6657-13b5-4ee0-a074-96edc0662df3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1677 microversion: 2.1 time: 0.165565 Jun 16 16:25:32.705777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 591/1181] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:32 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:32.975490 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-52eb61a4-5377-4ed7-88b6-1573c9f9807b req-60907254-320c-4b18-9fe6-4470cd32bcfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bafabf3-13ed-41be-901c-30e718386cd5", "name": "network-vif-plugged", "status": "completed", "tag": "dec74a39-08d4-4c2a-a538-734af2b286ae"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:25:32.982703 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a4b6728b-07cb-4c5a-bfb0-9d3620335b89 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:32.983314 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a4b6728b-07cb-4c5a-bfb0-9d3620335b89 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 9bafabf3-13ed-41be-901c-30e718386cd5] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:32.983847 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-52eb61a4-5377-4ed7-88b6-1573c9f9807b req-60907254-320c-4b18-9fe6-4470cd32bcfa service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:32.984316 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-52eb61a4-5377-4ed7-88b6-1573c9f9807b req-60907254-320c-4b18-9fe6-4470cd32bcfa service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:32.990096 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a4b6728b-07cb-4c5a-bfb0-9d3620335b89 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:32.990552 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a4b6728b-07cb-4c5a-bfb0-9d3620335b89 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:32.991402 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a4b6728b-07cb-4c5a-bfb0-9d3620335b89 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:32.992071 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a4b6728b-07cb-4c5a-bfb0-9d3620335b89 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:32.995656 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-52eb61a4-5377-4ed7-88b6-1573c9f9807b req-60907254-320c-4b18-9fe6-4470cd32bcfa service nova] Creating event network-vif-plugged:dec74a39-08d4-4c2a-a538-734af2b286ae for instance 9bafabf3-13ed-41be-901c-30e718386cd5 on hv-cinder-83735 Jun 16 16:25:33.001384 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-52eb61a4-5377-4ed7-88b6-1573c9f9807b req-60907254-320c-4b18-9fe6-4470cd32bcfa service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189430 Jun 16 16:25:33.002014 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 591/1182] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:25:33.144108 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a4b6728b-07cb-4c5a-bfb0-9d3620335b89 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:33.152906 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a4b6728b-07cb-4c5a-bfb0-9d3620335b89 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5" status: 200 len: 1313 microversion: 2.1 time: 0.174021 Jun 16 16:25:33.153474 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 592/1183] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:32 2022] GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:25:33.717667 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:33.722313 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d4445759-196c-41b6-8e07-e642a2926802 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:33.723019 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d4445759-196c-41b6-8e07-e642a2926802 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:33.729483 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d4445759-196c-41b6-8e07-e642a2926802 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:33.729958 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d4445759-196c-41b6-8e07-e642a2926802 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:33.730722 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d4445759-196c-41b6-8e07-e642a2926802 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:33.731161 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d4445759-196c-41b6-8e07-e642a2926802 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:33.868581 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d4445759-196c-41b6-8e07-e642a2926802 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:33.877306 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d4445759-196c-41b6-8e07-e642a2926802 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1677 microversion: 2.1 time: 0.160564 Jun 16 16:25:33.878938 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 592/1184] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:33 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:34.169701 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a3a68543-420f-43cb-9e2c-30aeb8137762 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:34.170322 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a3a68543-420f-43cb-9e2c-30aeb8137762 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 9bafabf3-13ed-41be-901c-30e718386cd5] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:34.172390 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:34.173034 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=6 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:34.179390 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a3a68543-420f-43cb-9e2c-30aeb8137762 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:34.179827 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a3a68543-420f-43cb-9e2c-30aeb8137762 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:34.180565 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a3a68543-420f-43cb-9e2c-30aeb8137762 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:34.180987 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a3a68543-420f-43cb-9e2c-30aeb8137762 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:34.308212 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a3a68543-420f-43cb-9e2c-30aeb8137762 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:34.315969 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a3a68543-420f-43cb-9e2c-30aeb8137762 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5" status: 200 len: 1313 microversion: 2.1 time: 0.150088 Jun 16 16:25:34.316725 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 593/1185] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:34 2022] GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:34.894345 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-36406510-d630-44f0-8af7-a3c098faa9a5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:34.895014 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-36406510-d630-44f0-8af7-a3c098faa9a5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:34.901401 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-36406510-d630-44f0-8af7-a3c098faa9a5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:34.901884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-36406510-d630-44f0-8af7-a3c098faa9a5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:34.902705 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-36406510-d630-44f0-8af7-a3c098faa9a5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:34.903142 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-36406510-d630-44f0-8af7-a3c098faa9a5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:35.031053 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-36406510-d630-44f0-8af7-a3c098faa9a5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:35.038887 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-36406510-d630-44f0-8af7-a3c098faa9a5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1677 microversion: 2.1 time: 0.148985 Jun 16 16:25:35.039510 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 593/1186] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:34 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:35.331955 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e7fe5824-dd6b-4c6c-b638-b72cf71135da tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:35.332576 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e7fe5824-dd6b-4c6c-b638-b72cf71135da tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 9bafabf3-13ed-41be-901c-30e718386cd5] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:35.339273 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e7fe5824-dd6b-4c6c-b638-b72cf71135da tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:35.339726 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e7fe5824-dd6b-4c6c-b638-b72cf71135da tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:35.340489 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e7fe5824-dd6b-4c6c-b638-b72cf71135da tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:35.340926 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e7fe5824-dd6b-4c6c-b638-b72cf71135da tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:35.471264 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e7fe5824-dd6b-4c6c-b638-b72cf71135da tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:35.478974 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e7fe5824-dd6b-4c6c-b638-b72cf71135da tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5" status: 200 len: 1497 microversion: 2.1 time: 0.150919 Jun 16 16:25:35.479540 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 594/1187] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:35 2022] GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5 => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:36.056069 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-81c00b93-9191-48ff-a1f9-770897bf296c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:36.056674 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-81c00b93-9191-48ff-a1f9-770897bf296c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:36.063298 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-81c00b93-9191-48ff-a1f9-770897bf296c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:36.063738 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-81c00b93-9191-48ff-a1f9-770897bf296c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:36.064497 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-81c00b93-9191-48ff-a1f9-770897bf296c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:36.064928 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-81c00b93-9191-48ff-a1f9-770897bf296c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:36.194365 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-81c00b93-9191-48ff-a1f9-770897bf296c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:36.203428 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-81c00b93-9191-48ff-a1f9-770897bf296c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1677 microversion: 2.1 time: 0.150686 Jun 16 16:25:36.204241 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 594/1188] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:36 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:36.296800 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-840b4705-86a8-4b3e-bee8-3fb0c77d1b9a tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:36.297291 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-840b4705-86a8-4b3e-bee8-3fb0c77d1b9a tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 9bafabf3-13ed-41be-901c-30e718386cd5] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:36.303549 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-840b4705-86a8-4b3e-bee8-3fb0c77d1b9a tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:36.303994 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-840b4705-86a8-4b3e-bee8-3fb0c77d1b9a tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:36.304739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-840b4705-86a8-4b3e-bee8-3fb0c77d1b9a tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:36.305189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-840b4705-86a8-4b3e-bee8-3fb0c77d1b9a tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:36.329683 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-840b4705-86a8-4b3e-bee8-3fb0c77d1b9a tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 9bafabf3-13ed-41be-901c-30e718386cd5] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:25:36.403436 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-840b4705-86a8-4b3e-bee8-3fb0c77d1b9a tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5" status: 204 len: 0 microversion: 2.1 time: 0.110062 Jun 16 16:25:36.404214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 595/1189] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:25:36 2022] DELETE /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:25:36.412479 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b831629b-b967-4e8f-8fea-79d02d795ca9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:36.413175 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b831629b-b967-4e8f-8fea-79d02d795ca9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 9bafabf3-13ed-41be-901c-30e718386cd5] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:36.419103 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b831629b-b967-4e8f-8fea-79d02d795ca9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:36.419540 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b831629b-b967-4e8f-8fea-79d02d795ca9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:36.420288 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b831629b-b967-4e8f-8fea-79d02d795ca9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:36.420716 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b831629b-b967-4e8f-8fea-79d02d795ca9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:36.553186 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b831629b-b967-4e8f-8fea-79d02d795ca9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:36.560569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b831629b-b967-4e8f-8fea-79d02d795ca9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5" status: 200 len: 1503 microversion: 2.1 time: 0.151954 Jun 16 16:25:36.561126 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 595/1190] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:36 2022] GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:37.221927 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-eb636566-d571-4c12-ad49-3226669e5fc3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:37.222619 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-eb636566-d571-4c12-ad49-3226669e5fc3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:37.228552 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb636566-d571-4c12-ad49-3226669e5fc3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:37.228994 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb636566-d571-4c12-ad49-3226669e5fc3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:37.229761 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb636566-d571-4c12-ad49-3226669e5fc3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:37.230196 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb636566-d571-4c12-ad49-3226669e5fc3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:37.357931 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-eb636566-d571-4c12-ad49-3226669e5fc3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:37.365658 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-eb636566-d571-4c12-ad49-3226669e5fc3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1677 microversion: 2.1 time: 0.148249 Jun 16 16:25:37.366265 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 596/1191] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:37 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:37.578469 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e3d1c54a-bad0-4ccc-bc7a-6700b2dd06a9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:37.579097 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e3d1c54a-bad0-4ccc-bc7a-6700b2dd06a9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 9bafabf3-13ed-41be-901c-30e718386cd5] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:37.585469 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e3d1c54a-bad0-4ccc-bc7a-6700b2dd06a9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:37.585948 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e3d1c54a-bad0-4ccc-bc7a-6700b2dd06a9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:37.586700 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e3d1c54a-bad0-4ccc-bc7a-6700b2dd06a9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:37.587128 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e3d1c54a-bad0-4ccc-bc7a-6700b2dd06a9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:37.713690 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e3d1c54a-bad0-4ccc-bc7a-6700b2dd06a9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:37.722020 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e3d1c54a-bad0-4ccc-bc7a-6700b2dd06a9 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5" status: 200 len: 1503 microversion: 2.1 time: 0.147717 Jun 16 16:25:37.722581 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 596/1192] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:37 2022] GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:38.383151 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a7617d53-2220-43ba-8eec-49c21078f3ad tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:38.383669 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a7617d53-2220-43ba-8eec-49c21078f3ad tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:38.390202 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a7617d53-2220-43ba-8eec-49c21078f3ad tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:38.390634 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a7617d53-2220-43ba-8eec-49c21078f3ad tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:38.391397 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a7617d53-2220-43ba-8eec-49c21078f3ad tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:38.391832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a7617d53-2220-43ba-8eec-49c21078f3ad tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:38.595559 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a7617d53-2220-43ba-8eec-49c21078f3ad tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:38.603411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a7617d53-2220-43ba-8eec-49c21078f3ad tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1677 microversion: 2.1 time: 0.224169 Jun 16 16:25:38.603906 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 597/1193] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:38 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1677 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:38.739366 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c17db3b8-9d60-4bff-b380-04f9b9568988 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:38.739991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c17db3b8-9d60-4bff-b380-04f9b9568988 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 9bafabf3-13ed-41be-901c-30e718386cd5] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:38.748629 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c17db3b8-9d60-4bff-b380-04f9b9568988 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:38.749139 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c17db3b8-9d60-4bff-b380-04f9b9568988 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:38.750099 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c17db3b8-9d60-4bff-b380-04f9b9568988 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:38.750546 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c17db3b8-9d60-4bff-b380-04f9b9568988 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:38.840504 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c17db3b8-9d60-4bff-b380-04f9b9568988 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:38.841411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-5e180411-4028-4b9b-8fb8-4b85644f5a95 req-5dfb2db0-2b8f-47c4-b491-719e674b2908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bafabf3-13ed-41be-901c-30e718386cd5", "name": "network-vif-deleted", "tag": "dec74a39-08d4-4c2a-a538-734af2b286ae"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:25:38.850583 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c17db3b8-9d60-4bff-b380-04f9b9568988 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5" status: 200 len: 1461 microversion: 2.1 time: 0.114928 Jun 16 16:25:38.851185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 597/1194] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:38 2022] GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5 => generated 1461 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:38.851295 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-5e180411-4028-4b9b-8fb8-4b85644f5a95 req-5dfb2db0-2b8f-47c4-b491-719e674b2908 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:38.851625 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-5e180411-4028-4b9b-8fb8-4b85644f5a95 req-5dfb2db0-2b8f-47c4-b491-719e674b2908 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:38.863285 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-5e180411-4028-4b9b-8fb8-4b85644f5a95 req-5dfb2db0-2b8f-47c4-b491-719e674b2908 service nova] Creating event network-vif-deleted:dec74a39-08d4-4c2a-a538-734af2b286ae for instance 9bafabf3-13ed-41be-901c-30e718386cd5 on hv-cinder-83735 Jun 16 16:25:38.867979 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-5e180411-4028-4b9b-8fb8-4b85644f5a95 req-5dfb2db0-2b8f-47c4-b491-719e674b2908 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030521 Jun 16 16:25:38.868604 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 598/1195] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:25:39.620486 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-204cb6fa-f857-41fe-a605-5898398356b8 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:39.621289 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-204cb6fa-f857-41fe-a605-5898398356b8 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:39.628423 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-204cb6fa-f857-41fe-a605-5898398356b8 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:39.628934 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-204cb6fa-f857-41fe-a605-5898398356b8 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:39.629874 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-204cb6fa-f857-41fe-a605-5898398356b8 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:39.630312 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-204cb6fa-f857-41fe-a605-5898398356b8 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:39.763058 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-204cb6fa-f857-41fe-a605-5898398356b8 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:39.771182 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-204cb6fa-f857-41fe-a605-5898398356b8 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1677 microversion: 2.1 time: 0.154855 Jun 16 16:25:39.771774 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 598/1196] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:39 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:39.869331 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bc560fe8-6d68-44f8-87ec-1a8c7d16d445 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:39.870075 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-bc560fe8-6d68-44f8-87ec-1a8c7d16d445 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 9bafabf3-13ed-41be-901c-30e718386cd5] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:39.876919 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bc560fe8-6d68-44f8-87ec-1a8c7d16d445 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:39.877370 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bc560fe8-6d68-44f8-87ec-1a8c7d16d445 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:39.878164 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bc560fe8-6d68-44f8-87ec-1a8c7d16d445 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:39.878601 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bc560fe8-6d68-44f8-87ec-1a8c7d16d445 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:39.892220 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-bc560fe8-6d68-44f8-87ec-1a8c7d16d445 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] HTTP exception thrown: Instance 9bafabf3-13ed-41be-901c-30e718386cd5 could not be found. Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bc560fe8-6d68-44f8-87ec-1a8c7d16d445 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Request method failure captured: Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5 HTTP/1.1 Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1lxfYlHdQYRhzh_hf87-D0UlW5e7ewMK0IEZevW_qtGIK_XSvG9CGzXwlBUflHyVE22MrBypt7BOSE3y7BmoX6ShEkBE0oQvf7SzNJzkTZFLtRCtY6NBghPEJuHoeopK7d4UgmUCclywgwvwO6TfpXzhnJabHBZziBL3Bss9rNTPnk Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: a4902d01c5044cad97843dd5f4742de9 Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-VolumesActionsTest-611058606 Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:25:39.893893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:25:39.895640 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a4902d01c5044cad97843dd5f4742de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a4902d01c5044cad97843dd5f4742de9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a4902d01c5044cad97843dd5f4742de9", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a4902d01c5044cad97843dd5f4742de9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:25:39.895640 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-VolumesActionsTest-611058606 Jun 16 16:25:39.895640 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: a4902d01c5044cad97843dd5f4742de9 Jun 16 16:25:39.895640 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-VolumesActionsTest-611058606 Jun 16 16:25:39.895640 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-VolumesActionsTest-611058606-project Jun 16 16:25:39.895640 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:25:39.895640 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:25:39.895640 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: db1d1606f20a4807b52756f2169b5fe4 Jun 16 16:25:39.895640 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-VolumesActionsTest-611058606-project Jun 16 16:25:39.895640 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:25:39.895640 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance 9bafabf3-13ed-41be-901c-30e718386cd5 could not be found. Jun 16 16:25:39.895640 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '9bafabf3-13ed-41be-901c-30e718386cd5'} Jun 16 16:25:39.896730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:25:39.896730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:39.896730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:25:39.896730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:25:39.896730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:25:39.896730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:25:39.896730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:25:39.896730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:25:39.896730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:25:39.896730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:25:39.896730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bafabf3-13ed-41be-901c-30e718386cd5 could not be found. Jun 16 16:25:39.896730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:25:39.896730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:39.896730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:25:39.896730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:39.896730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:25:39.896730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:25:39.896730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:25:39.896730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:25:39.896730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:25:39.898189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:25:39.898189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:25:39.898189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:25:39.898189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:25:39.898189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:25:39.898189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:25:39.898189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:25:39.898189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bafabf3-13ed-41be-901c-30e718386cd5 could not be found. Jun 16 16:25:39.898189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:25:39.898189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:25:39.898189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:25:39.898189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:25:39.898189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:25:39.898189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:25:39.898189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:25:39.898189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:25:39.898189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bafabf3-13ed-41be-901c-30e718386cd5 could not be found. Jun 16 16:25:39.898189 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:25:39.899535 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bc560fe8-6d68-44f8-87ec-1a8c7d16d445 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Returning 404 to user: Instance 9bafabf3-13ed-41be-901c-30e718386cd5 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:25:39.899535 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-bc560fe8-6d68-44f8-87ec-1a8c7d16d445 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5" status: 404 len: 111 microversion: 2.1 time: 0.030816 Jun 16 16:25:39.899535 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 599/1197] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:39 2022] GET /compute/v2.1/servers/9bafabf3-13ed-41be-901c-30e718386cd5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:25:39.989192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4bb745ae-8e2e-4769-a036-658ea78f3dc6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-842124473", "imageRef": "d2716dc1-3d4d-4f62-b0af-c38986f2a3aa", "flavorRef": "452", "networks": [{"uuid": "55b2b9aa-7687-4c75-bbb1-e15bb885a239"}]}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:25:40.039874 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-4bb745ae-8e2e-4769-a036-658ea78f3dc6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] validate_networks() for [('55b2b9aa-7687-4c75-bbb1-e15bb885a239', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:25:40.487260 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-4bb745ae-8e2e-4769-a036-658ea78f3dc6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:25:40.487666 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-4bb745ae-8e2e-4769-a036-658ea78f3dc6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:25:40.488144 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-4bb745ae-8e2e-4769-a036-658ea78f3dc6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:25:40.488554 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-4bb745ae-8e2e-4769-a036-658ea78f3dc6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:25:40.488966 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-4bb745ae-8e2e-4769-a036-658ea78f3dc6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:25:40.497815 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4bb745ae-8e2e-4769-a036-658ea78f3dc6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:40.498269 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4bb745ae-8e2e-4769-a036-658ea78f3dc6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:40.499076 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4bb745ae-8e2e-4769-a036-658ea78f3dc6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:40.499513 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4bb745ae-8e2e-4769-a036-658ea78f3dc6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:40.517006 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-4bb745ae-8e2e-4769-a036-658ea78f3dc6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Getting quotas for project a4902d01c5044cad97843dd5f4742de9. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:25:40.520936 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-4bb745ae-8e2e-4769-a036-658ea78f3dc6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Getting quotas for user db1d1606f20a4807b52756f2169b5fe4 and project a4902d01c5044cad97843dd5f4742de9. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:25:40.532624 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4bb745ae-8e2e-4769-a036-658ea78f3dc6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:25:40.534902 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4bb745ae-8e2e-4769-a036-658ea78f3dc6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2716dc1-3d4d-4f62-b0af-c38986f2a3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:25:40.579987 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4bb745ae-8e2e-4769-a036-658ea78f3dc6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594510 Jun 16 16:25:40.580632 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 599/1198] 10.222.0.88 () {60 vars in 1146 bytes} [Thu Jun 16 16:25:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:25:40.590515 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-27fa730d-4ad9-4b44-9df7-56c48be1cdc8 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:40.591123 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-27fa730d-4ad9-4b44-9df7-56c48be1cdc8 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:40.646774 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-27fa730d-4ad9-4b44-9df7-56c48be1cdc8 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:40.653520 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-27fa730d-4ad9-4b44-9df7-56c48be1cdc8 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f" status: 200 len: 1213 microversion: 2.1 time: 0.066817 Jun 16 16:25:40.654374 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 600/1199] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:40 2022] GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:40.789270 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ea4e72dc-58c9-43b8-8454-bd98894e90c3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:40.790053 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ea4e72dc-58c9-43b8-8454-bd98894e90c3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:40.797407 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ea4e72dc-58c9-43b8-8454-bd98894e90c3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:40.797901 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ea4e72dc-58c9-43b8-8454-bd98894e90c3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:40.798865 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ea4e72dc-58c9-43b8-8454-bd98894e90c3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:40.799325 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ea4e72dc-58c9-43b8-8454-bd98894e90c3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:40.942898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ea4e72dc-58c9-43b8-8454-bd98894e90c3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:40.951610 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ea4e72dc-58c9-43b8-8454-bd98894e90c3 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1677 microversion: 2.1 time: 0.167223 Jun 16 16:25:40.952228 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 600/1200] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:40 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:41.670979 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b72c2b7e-4a05-4433-bd65-eef523842d66 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:41.672124 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b72c2b7e-4a05-4433-bd65-eef523842d66 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:41.681739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b72c2b7e-4a05-4433-bd65-eef523842d66 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:41.682258 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b72c2b7e-4a05-4433-bd65-eef523842d66 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:41.683015 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b72c2b7e-4a05-4433-bd65-eef523842d66 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:41.683443 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b72c2b7e-4a05-4433-bd65-eef523842d66 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:41.748055 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b72c2b7e-4a05-4433-bd65-eef523842d66 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:41.755743 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b72c2b7e-4a05-4433-bd65-eef523842d66 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f" status: 200 len: 1265 microversion: 2.1 time: 0.088646 Jun 16 16:25:41.756301 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 601/1201] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:41 2022] GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:41.969009 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-dfaa6b70-c968-4e99-8861-5b5141e155fb tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:41.969540 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dfaa6b70-c968-4e99-8861-5b5141e155fb tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:41.976937 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dfaa6b70-c968-4e99-8861-5b5141e155fb tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:41.978151 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dfaa6b70-c968-4e99-8861-5b5141e155fb tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:41.978970 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dfaa6b70-c968-4e99-8861-5b5141e155fb tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:41.979414 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dfaa6b70-c968-4e99-8861-5b5141e155fb tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:42.195439 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dfaa6b70-c968-4e99-8861-5b5141e155fb tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:42.203520 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-dfaa6b70-c968-4e99-8861-5b5141e155fb tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1654 microversion: 2.1 time: 0.239071 Jun 16 16:25:42.204181 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 601/1202] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:41 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1654 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:42.221819 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-104159b5-5084-4a1f-9cb8-51d3a33db3b2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:25:42.228207 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-104159b5-5084-4a1f-9cb8-51d3a33db3b2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:42.228724 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-104159b5-5084-4a1f-9cb8-51d3a33db3b2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:42.245008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:42.252020 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-104159b5-5084-4a1f-9cb8-51d3a33db3b2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Going to try to start instance {{(pid=117711) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 16:25:42.295293 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-104159b5-5084-4a1f-9cb8-51d3a33db3b2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "POST /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56/action" status: 202 len: 0 microversion: 2.1 time: 0.078614 Jun 16 16:25:42.296115 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 602/1203] 10.222.0.88 () {60 vars in 1277 bytes} [Thu Jun 16 16:25:42 2022] POST /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:25:42.303850 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6f95eb7e-aa83-437c-9c69-4d0152a7bfbc tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:42.304649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6f95eb7e-aa83-437c-9c69-4d0152a7bfbc tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:42.312383 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6f95eb7e-aa83-437c-9c69-4d0152a7bfbc tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:42.312946 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6f95eb7e-aa83-437c-9c69-4d0152a7bfbc tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:42.313795 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6f95eb7e-aa83-437c-9c69-4d0152a7bfbc tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:42.314284 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6f95eb7e-aa83-437c-9c69-4d0152a7bfbc tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:42.318909 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:42.601984 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6f95eb7e-aa83-437c-9c69-4d0152a7bfbc tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:42.609474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6f95eb7e-aa83-437c-9c69-4d0152a7bfbc tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1663 microversion: 2.1 time: 0.309408 Jun 16 16:25:42.610481 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 602/1204] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:42 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1663 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:42.774276 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b36aeb0f-c441-4749-a924-f62bf7b63dd1 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:42.775236 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b36aeb0f-c441-4749-a924-f62bf7b63dd1 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:42.782646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b36aeb0f-c441-4749-a924-f62bf7b63dd1 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:42.783244 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b36aeb0f-c441-4749-a924-f62bf7b63dd1 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:42.784131 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b36aeb0f-c441-4749-a924-f62bf7b63dd1 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:42.784628 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b36aeb0f-c441-4749-a924-f62bf7b63dd1 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:43.091699 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b36aeb0f-c441-4749-a924-f62bf7b63dd1 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:43.100579 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b36aeb0f-c441-4749-a924-f62bf7b63dd1 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f" status: 200 len: 1313 microversion: 2.1 time: 0.331668 Jun 16 16:25:43.101151 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 603/1205] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:42 2022] GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:43.626810 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a69f7299-0c16-4524-86f3-daa14d37c3b1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:43.627420 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a69f7299-0c16-4524-86f3-daa14d37c3b1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:43.634213 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a69f7299-0c16-4524-86f3-daa14d37c3b1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:43.634671 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a69f7299-0c16-4524-86f3-daa14d37c3b1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:43.635442 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a69f7299-0c16-4524-86f3-daa14d37c3b1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:43.635881 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a69f7299-0c16-4524-86f3-daa14d37c3b1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:43.843152 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-a69f7299-0c16-4524-86f3-daa14d37c3b1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:43.851590 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a69f7299-0c16-4524-86f3-daa14d37c3b1 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1663 microversion: 2.1 time: 0.229293 Jun 16 16:25:43.852161 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 603/1206] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:43 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1663 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:44.118461 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-03277226-c341-4836-a192-3b906d01cc97 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:44.119294 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-03277226-c341-4836-a192-3b906d01cc97 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:44.125535 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-03277226-c341-4836-a192-3b906d01cc97 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:44.126034 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-03277226-c341-4836-a192-3b906d01cc97 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:44.126800 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-03277226-c341-4836-a192-3b906d01cc97 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:44.127238 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-03277226-c341-4836-a192-3b906d01cc97 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:44.175182 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-d964ce76-6f89-4ac2-aa52-872cf2ccc50e req-d0518fd7-4d5e-4be5-9beb-f3098c056d00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44c7f97c-6f66-48e2-ae9e-d23c49f1d54f", "tag": "35c92c21-ce4c-465d-94bc-456a5e8bc730"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:25:44.183360 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-d964ce76-6f89-4ac2-aa52-872cf2ccc50e req-d0518fd7-4d5e-4be5-9beb-f3098c056d00 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:44.183808 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-d964ce76-6f89-4ac2-aa52-872cf2ccc50e req-d0518fd7-4d5e-4be5-9beb-f3098c056d00 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:44.195748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-d964ce76-6f89-4ac2-aa52-872cf2ccc50e req-d0518fd7-4d5e-4be5-9beb-f3098c056d00 service nova] Creating event network-changed:35c92c21-ce4c-465d-94bc-456a5e8bc730 for instance 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f on hv-cinder-83735 Jun 16 16:25:44.200576 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-d964ce76-6f89-4ac2-aa52-872cf2ccc50e req-d0518fd7-4d5e-4be5-9beb-f3098c056d00 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029762 Jun 16 16:25:44.201174 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 604/1207] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:25:44.317200 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-03277226-c341-4836-a192-3b906d01cc97 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:44.324646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-03277226-c341-4836-a192-3b906d01cc97 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f" status: 200 len: 1313 microversion: 2.1 time: 0.210019 Jun 16 16:25:44.325215 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 604/1208] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:44 2022] GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:44.869510 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-984e5af3-afd5-4753-9df4-29467508d06c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:44.870244 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-984e5af3-afd5-4753-9df4-29467508d06c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:44.876921 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-984e5af3-afd5-4753-9df4-29467508d06c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:44.877371 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-984e5af3-afd5-4753-9df4-29467508d06c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:44.878163 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-984e5af3-afd5-4753-9df4-29467508d06c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:44.878609 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-984e5af3-afd5-4753-9df4-29467508d06c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:45.075291 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-984e5af3-afd5-4753-9df4-29467508d06c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:45.083019 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-984e5af3-afd5-4753-9df4-29467508d06c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1667 microversion: 2.1 time: 0.218329 Jun 16 16:25:45.089635 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 605/1209] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:44 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1667 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:45.341923 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1ab1fe46-cf41-47b7-ad49-54fbc345972e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:45.342534 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1ab1fe46-cf41-47b7-ad49-54fbc345972e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:45.349674 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1ab1fe46-cf41-47b7-ad49-54fbc345972e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:45.350149 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1ab1fe46-cf41-47b7-ad49-54fbc345972e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:45.350905 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1ab1fe46-cf41-47b7-ad49-54fbc345972e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:45.351360 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1ab1fe46-cf41-47b7-ad49-54fbc345972e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:45.479913 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1ab1fe46-cf41-47b7-ad49-54fbc345972e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:45.487765 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1ab1fe46-cf41-47b7-ad49-54fbc345972e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f" status: 200 len: 1313 microversion: 2.1 time: 0.149742 Jun 16 16:25:45.488324 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 605/1210] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:45 2022] GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:46.504578 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1496bbd1-a4c7-45cc-addc-3336dff48103 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:46.505241 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1496bbd1-a4c7-45cc-addc-3336dff48103 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:46.512422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1496bbd1-a4c7-45cc-addc-3336dff48103 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:46.512898 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1496bbd1-a4c7-45cc-addc-3336dff48103 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:46.513663 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1496bbd1-a4c7-45cc-addc-3336dff48103 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:46.514126 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1496bbd1-a4c7-45cc-addc-3336dff48103 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:46.643756 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1496bbd1-a4c7-45cc-addc-3336dff48103 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:46.651192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1496bbd1-a4c7-45cc-addc-3336dff48103 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f" status: 200 len: 1313 microversion: 2.1 time: 0.150492 Jun 16 16:25:46.651753 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 606/1211] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:46 2022] GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:47.668409 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b195bd7e-7ade-46d6-93e1-bfc35bee2d0f tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:47.668950 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b195bd7e-7ade-46d6-93e1-bfc35bee2d0f tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:47.675618 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b195bd7e-7ade-46d6-93e1-bfc35bee2d0f tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:47.676068 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b195bd7e-7ade-46d6-93e1-bfc35bee2d0f tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:47.676823 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b195bd7e-7ade-46d6-93e1-bfc35bee2d0f tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:47.677265 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b195bd7e-7ade-46d6-93e1-bfc35bee2d0f tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:47.807690 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b195bd7e-7ade-46d6-93e1-bfc35bee2d0f tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:47.815603 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b195bd7e-7ade-46d6-93e1-bfc35bee2d0f tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f" status: 200 len: 1313 microversion: 2.1 time: 0.151151 Jun 16 16:25:47.816171 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 606/1212] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:47 2022] GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:48.832823 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c05fc7fb-30dd-48cc-9125-a2e0209e6d0e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:48.834182 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c05fc7fb-30dd-48cc-9125-a2e0209e6d0e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:48.849277 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c05fc7fb-30dd-48cc-9125-a2e0209e6d0e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:48.849972 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c05fc7fb-30dd-48cc-9125-a2e0209e6d0e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:48.851041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c05fc7fb-30dd-48cc-9125-a2e0209e6d0e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:48.851690 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c05fc7fb-30dd-48cc-9125-a2e0209e6d0e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:49.109703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c05fc7fb-30dd-48cc-9125-a2e0209e6d0e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:49.118105 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c05fc7fb-30dd-48cc-9125-a2e0209e6d0e tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f" status: 200 len: 1313 microversion: 2.1 time: 0.289536 Jun 16 16:25:49.118687 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 607/1213] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:48 2022] GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:50.136002 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-5927b391-ccc7-4806-b174-099dfb64af51 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:50.136745 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-5927b391-ccc7-4806-b174-099dfb64af51 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:50.145006 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5927b391-ccc7-4806-b174-099dfb64af51 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:50.145775 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5927b391-ccc7-4806-b174-099dfb64af51 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:50.146507 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5927b391-ccc7-4806-b174-099dfb64af51 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:50.147176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-5927b391-ccc7-4806-b174-099dfb64af51 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:50.286645 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-5927b391-ccc7-4806-b174-099dfb64af51 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:50.294242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-5927b391-ccc7-4806-b174-099dfb64af51 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f" status: 200 len: 1313 microversion: 2.1 time: 0.162374 Jun 16 16:25:50.294809 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 607/1214] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:50 2022] GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:51.310488 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-833981ae-89b0-4f4e-b2b6-77fa43ee714d tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:51.311101 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-833981ae-89b0-4f4e-b2b6-77fa43ee714d tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:51.314132 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:51.314776 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=6 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:51.320432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-833981ae-89b0-4f4e-b2b6-77fa43ee714d tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:51.320881 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-833981ae-89b0-4f4e-b2b6-77fa43ee714d tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:51.321648 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-833981ae-89b0-4f4e-b2b6-77fa43ee714d tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:51.322113 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-833981ae-89b0-4f4e-b2b6-77fa43ee714d tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:51.446880 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-833981ae-89b0-4f4e-b2b6-77fa43ee714d tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:51.454279 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-833981ae-89b0-4f4e-b2b6-77fa43ee714d tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f" status: 200 len: 1313 microversion: 2.1 time: 0.147579 Jun 16 16:25:51.454879 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 608/1215] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:51 2022] GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:52.080155 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-83a23253-b07c-49cf-bda5-cd7cc0f5f107 req-6fea5a62-0679-45df-ab05-ba4f08e412f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44c7f97c-6f66-48e2-ae9e-d23c49f1d54f", "name": "network-vif-plugged", "status": "completed", "tag": "35c92c21-ce4c-465d-94bc-456a5e8bc730"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:25:52.084339 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:52.091085 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-83a23253-b07c-49cf-bda5-cd7cc0f5f107 req-6fea5a62-0679-45df-ab05-ba4f08e412f8 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:52.091529 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-83a23253-b07c-49cf-bda5-cd7cc0f5f107 req-6fea5a62-0679-45df-ab05-ba4f08e412f8 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:52.103867 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-83a23253-b07c-49cf-bda5-cd7cc0f5f107 req-6fea5a62-0679-45df-ab05-ba4f08e412f8 service nova] Creating event network-vif-plugged:35c92c21-ce4c-465d-94bc-456a5e8bc730 for instance 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f on hv-cinder-83735 Jun 16 16:25:52.109030 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-83a23253-b07c-49cf-bda5-cd7cc0f5f107 req-6fea5a62-0679-45df-ab05-ba4f08e412f8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033102 Jun 16 16:25:52.109641 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 608/1216] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:25:52.471120 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6e77dd99-40b4-48e2-825f-06086fddfcfe tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:52.471991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6e77dd99-40b4-48e2-825f-06086fddfcfe tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:52.478478 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6e77dd99-40b4-48e2-825f-06086fddfcfe tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:52.479012 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6e77dd99-40b4-48e2-825f-06086fddfcfe tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:52.479778 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6e77dd99-40b4-48e2-825f-06086fddfcfe tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:52.480218 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6e77dd99-40b4-48e2-825f-06086fddfcfe tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:52.607591 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6e77dd99-40b4-48e2-825f-06086fddfcfe tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:52.615480 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6e77dd99-40b4-48e2-825f-06086fddfcfe tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f" status: 200 len: 1313 microversion: 2.1 time: 0.148188 Jun 16 16:25:52.616081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 609/1217] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:52 2022] GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:53.633485 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7431bb1a-b1a5-4fa4-ba2f-3345fb2721fe tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:53.634126 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7431bb1a-b1a5-4fa4-ba2f-3345fb2721fe tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:53.636011 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:53.641963 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7431bb1a-b1a5-4fa4-ba2f-3345fb2721fe tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:53.642413 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7431bb1a-b1a5-4fa4-ba2f-3345fb2721fe tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:53.643209 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7431bb1a-b1a5-4fa4-ba2f-3345fb2721fe tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:53.643646 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7431bb1a-b1a5-4fa4-ba2f-3345fb2721fe tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:53.775864 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7431bb1a-b1a5-4fa4-ba2f-3345fb2721fe tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:53.783728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7431bb1a-b1a5-4fa4-ba2f-3345fb2721fe tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f" status: 200 len: 1313 microversion: 2.1 time: 0.155002 Jun 16 16:25:53.784295 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 609/1218] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:53 2022] GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:54.801059 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c4331d62-9b0b-48f9-a634-d8a346eff0b4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:54.801675 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c4331d62-9b0b-48f9-a634-d8a346eff0b4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:54.804001 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:54.809250 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c4331d62-9b0b-48f9-a634-d8a346eff0b4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:54.809701 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c4331d62-9b0b-48f9-a634-d8a346eff0b4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:54.810490 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c4331d62-9b0b-48f9-a634-d8a346eff0b4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:54.811016 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c4331d62-9b0b-48f9-a634-d8a346eff0b4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:54.945664 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c4331d62-9b0b-48f9-a634-d8a346eff0b4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:54.954412 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c4331d62-9b0b-48f9-a634-d8a346eff0b4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f" status: 200 len: 1313 microversion: 2.1 time: 0.157276 Jun 16 16:25:54.954979 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 610/1219] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:54 2022] GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:55.972010 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1074bfee-286e-4407-bffe-c06a1f5841d4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:55.972604 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1074bfee-286e-4407-bffe-c06a1f5841d4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:55.979148 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1074bfee-286e-4407-bffe-c06a1f5841d4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:55.979589 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1074bfee-286e-4407-bffe-c06a1f5841d4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:55.980338 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1074bfee-286e-4407-bffe-c06a1f5841d4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:55.980766 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1074bfee-286e-4407-bffe-c06a1f5841d4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:56.111883 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1074bfee-286e-4407-bffe-c06a1f5841d4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:56.119513 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1074bfee-286e-4407-bffe-c06a1f5841d4 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f" status: 200 len: 1313 microversion: 2.1 time: 0.152237 Jun 16 16:25:56.120071 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 610/1220] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:55 2022] GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:57.138142 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b0e258ab-d57b-4227-91a8-9b62bea58e14 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:57.138870 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b0e258ab-d57b-4227-91a8-9b62bea58e14 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:57.145616 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b0e258ab-d57b-4227-91a8-9b62bea58e14 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:57.146098 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b0e258ab-d57b-4227-91a8-9b62bea58e14 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:57.146862 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b0e258ab-d57b-4227-91a8-9b62bea58e14 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:57.147428 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b0e258ab-d57b-4227-91a8-9b62bea58e14 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:57.275109 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b0e258ab-d57b-4227-91a8-9b62bea58e14 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:57.282650 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b0e258ab-d57b-4227-91a8-9b62bea58e14 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f" status: 200 len: 1498 microversion: 2.1 time: 0.148410 Jun 16 16:25:57.283221 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 611/1221] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:57 2022] GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:57.777375 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-05bf61aa-8502-43fd-9ccc-3633f7275fa6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:57.778453 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-05bf61aa-8502-43fd-9ccc-3633f7275fa6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:57.785066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05bf61aa-8502-43fd-9ccc-3633f7275fa6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:57.785515 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05bf61aa-8502-43fd-9ccc-3633f7275fa6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:57.786383 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05bf61aa-8502-43fd-9ccc-3633f7275fa6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:57.786784 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-05bf61aa-8502-43fd-9ccc-3633f7275fa6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:57.815721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-05bf61aa-8502-43fd-9ccc-3633f7275fa6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:25:57.888787 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-05bf61aa-8502-43fd-9ccc-3633f7275fa6 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "DELETE /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f" status: 204 len: 0 microversion: 2.1 time: 0.115118 Jun 16 16:25:57.889375 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 611/1222] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:25:57 2022] DELETE /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:25:57.899033 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-53937b35-6116-4d25-9280-62379b536f73 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:57.899644 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-53937b35-6116-4d25-9280-62379b536f73 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:57.906174 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-53937b35-6116-4d25-9280-62379b536f73 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:57.906625 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-53937b35-6116-4d25-9280-62379b536f73 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:57.907389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-53937b35-6116-4d25-9280-62379b536f73 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:57.907824 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-53937b35-6116-4d25-9280-62379b536f73 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:58.038568 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-53937b35-6116-4d25-9280-62379b536f73 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:58.048105 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-53937b35-6116-4d25-9280-62379b536f73 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f" status: 200 len: 1504 microversion: 2.1 time: 0.153757 Jun 16 16:25:58.048784 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 612/1223] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:57 2022] GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:25:59.065442 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2ab6937e-8b40-43d6-a3ed-267e3d52123c tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:25:59.066163 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2ab6937e-8b40-43d6-a3ed-267e3d52123c tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:25:59.072552 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2ab6937e-8b40-43d6-a3ed-267e3d52123c tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:59.072934 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2ab6937e-8b40-43d6-a3ed-267e3d52123c tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:59.073679 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2ab6937e-8b40-43d6-a3ed-267e3d52123c tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:25:59.074232 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2ab6937e-8b40-43d6-a3ed-267e3d52123c tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:25:59.208770 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2ab6937e-8b40-43d6-a3ed-267e3d52123c tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:25:59.216793 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2ab6937e-8b40-43d6-a3ed-267e3d52123c tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f" status: 200 len: 1504 microversion: 2.1 time: 0.156054 Jun 16 16:25:59.217383 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 612/1224] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:25:59 2022] GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:26:00.234841 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b58dd22e-d205-4132-8fbb-b46cb732363b tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:00.235728 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b58dd22e-d205-4132-8fbb-b46cb732363b tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:26:00.243126 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b58dd22e-d205-4132-8fbb-b46cb732363b tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:00.244512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b58dd22e-d205-4132-8fbb-b46cb732363b tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:00.245533 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b58dd22e-d205-4132-8fbb-b46cb732363b tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:00.246213 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b58dd22e-d205-4132-8fbb-b46cb732363b tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:00.269551 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-d4a382d7-34c0-41f2-8648-9846ceb4ed63 req-76b7466e-23b2-42d4-b467-93cdd76d2cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44c7f97c-6f66-48e2-ae9e-d23c49f1d54f", "name": "network-vif-deleted", "tag": "35c92c21-ce4c-465d-94bc-456a5e8bc730"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:26:00.280112 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-d4a382d7-34c0-41f2-8648-9846ceb4ed63 req-76b7466e-23b2-42d4-b467-93cdd76d2cc8 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:00.280554 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-d4a382d7-34c0-41f2-8648-9846ceb4ed63 req-76b7466e-23b2-42d4-b467-93cdd76d2cc8 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:00.293120 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-d4a382d7-34c0-41f2-8648-9846ceb4ed63 req-76b7466e-23b2-42d4-b467-93cdd76d2cc8 service nova] Creating event network-vif-deleted:35c92c21-ce4c-465d-94bc-456a5e8bc730 for instance 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f on hv-cinder-83735 Jun 16 16:26:00.299505 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-d4a382d7-34c0-41f2-8648-9846ceb4ed63 req-76b7466e-23b2-42d4-b467-93cdd76d2cc8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037528 Jun 16 16:26:00.300785 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 613/1225] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:26:00.316371 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b58dd22e-d205-4132-8fbb-b46cb732363b tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1d1606f20a4807b52756f2169b5fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4902d01c5044cad97843dd5f4742de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:26:00.323831 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b58dd22e-d205-4132-8fbb-b46cb732363b tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f" status: 200 len: 1462 microversion: 2.1 time: 0.093555 Jun 16 16:26:00.324432 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 613/1226] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:26:00 2022] GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f => generated 1462 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:26:01.341655 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-293af195-1585-4f77-9a9a-df9abeb0a5c2 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:26:01.342317 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-293af195-1585-4f77-9a9a-df9abeb0a5c2 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] [instance: 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:26:01.349267 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-293af195-1585-4f77-9a9a-df9abeb0a5c2 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:01.349735 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-293af195-1585-4f77-9a9a-df9abeb0a5c2 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:01.350501 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-293af195-1585-4f77-9a9a-df9abeb0a5c2 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:26:01.351139 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-293af195-1585-4f77-9a9a-df9abeb0a5c2 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:26:01.366633 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-293af195-1585-4f77-9a9a-df9abeb0a5c2 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] HTTP exception thrown: Instance 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f could not be found. Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-293af195-1585-4f77-9a9a-df9abeb0a5c2 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Request method failure captured: Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f HTTP/1.1 Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1lxfYlHdQYRhzh_hf87-D0UlW5e7ewMK0IEZevW_qtGIK_XSvG9CGzXwlBUflHyVE22MrBypt7BOSE3y7BmoX6ShEkBE0oQvf7SzNJzkTZFLtRCtY6NBghPEJuHoeopK7d4UgmUCclywgwvwO6TfpXzhnJabHBZziBL3Bss9rNTPnk Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: a4902d01c5044cad97843dd5f4742de9 Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-VolumesActionsTest-611058606 Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:26:01.368649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:26:01.370412 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a4902d01c5044cad97843dd5f4742de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a4902d01c5044cad97843dd5f4742de9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a4902d01c5044cad97843dd5f4742de9", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a4902d01c5044cad97843dd5f4742de9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:26:01.370412 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-VolumesActionsTest-611058606 Jun 16 16:26:01.370412 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: a4902d01c5044cad97843dd5f4742de9 Jun 16 16:26:01.370412 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-VolumesActionsTest-611058606 Jun 16 16:26:01.370412 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-VolumesActionsTest-611058606-project Jun 16 16:26:01.370412 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:26:01.370412 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:26:01.370412 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: db1d1606f20a4807b52756f2169b5fe4 Jun 16 16:26:01.370412 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-VolumesActionsTest-611058606-project Jun 16 16:26:01.370412 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:26:01.370412 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f could not be found. Jun 16 16:26:01.370412 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '44c7f97c-6f66-48e2-ae9e-d23c49f1d54f'} Jun 16 16:26:01.371767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:26:01.371767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:26:01.371767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:26:01.371767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:26:01.371767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:26:01.371767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:26:01.371767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:26:01.371767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:26:01.371767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:26:01.371767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:26:01.371767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f could not be found. Jun 16 16:26:01.371767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:26:01.371767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:26:01.371767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:26:01.371767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:26:01.371767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:26:01.371767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:26:01.371767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:26:01.371767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:26:01.371767 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:26:01.374877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:26:01.374877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:26:01.374877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:26:01.374877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:26:01.374877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:26:01.374877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:26:01.374877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:26:01.374877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f could not be found. Jun 16 16:26:01.374877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:26:01.374877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:26:01.374877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:26:01.374877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:26:01.374877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:26:01.374877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:26:01.374877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:26:01.374877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:26:01.374877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f could not be found. Jun 16 16:26:01.374877 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:26:01.376716 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-293af195-1585-4f77-9a9a-df9abeb0a5c2 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] Returning 404 to user: Instance 44c7f97c-6f66-48e2-ae9e-d23c49f1d54f could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:26:01.376716 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-293af195-1585-4f77-9a9a-df9abeb0a5c2 tempest-VolumesActionsTest-611058606 tempest-VolumesActionsTest-611058606-project] 10.222.0.88 "GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f" status: 404 len: 111 microversion: 2.1 time: 0.032820 Jun 16 16:26:01.376716 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 614/1227] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:26:01 2022] GET /compute/v2.1/servers/44c7f97c-6f66-48e2-ae9e-d23c49f1d54f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:27:17.505181 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=7 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:17.505951 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=66 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:17.509949 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-159bb1b3-5e9a-49b8-aa0c-cb1793565df6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:17.510867 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-159bb1b3-5e9a-49b8-aa0c-cb1793565df6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:27:17.518041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-159bb1b3-5e9a-49b8-aa0c-cb1793565df6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:17.518484 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-159bb1b3-5e9a-49b8-aa0c-cb1793565df6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:17.519231 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-159bb1b3-5e9a-49b8-aa0c-cb1793565df6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:17.519696 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-159bb1b3-5e9a-49b8-aa0c-cb1793565df6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:17.547604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-159bb1b3-5e9a-49b8-aa0c-cb1793565df6 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044097 Jun 16 16:27:17.548145 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 614/1228] 10.222.0.88 () {58 vars in 1301 bytes} [Thu Jun 16 16:27:17 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:27:17.602501 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:17.603240 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:17.607100 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f3e636f0-e72c-4816-a0bf-d483691ad97c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:17.607594 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f3e636f0-e72c-4816-a0bf-d483691ad97c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:27:17.614971 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3e636f0-e72c-4816-a0bf-d483691ad97c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:17.615430 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3e636f0-e72c-4816-a0bf-d483691ad97c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:17.616242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3e636f0-e72c-4816-a0bf-d483691ad97c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:17.616633 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f3e636f0-e72c-4816-a0bf-d483691ad97c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:17.643555 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f3e636f0-e72c-4816-a0bf-d483691ad97c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:27:17.716416 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f3e636f0-e72c-4816-a0bf-d483691ad97c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 204 len: 0 microversion: 2.1 time: 0.115621 Jun 16 16:27:17.717005 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 615/1229] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:27:17 2022] DELETE /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:27:17.726038 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-63fcbd4e-02f0-4a8d-94aa-e1abfeff2388 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:17.726739 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-63fcbd4e-02f0-4a8d-94aa-e1abfeff2388 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:27:17.733513 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-63fcbd4e-02f0-4a8d-94aa-e1abfeff2388 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:17.733993 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-63fcbd4e-02f0-4a8d-94aa-e1abfeff2388 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:17.734792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-63fcbd4e-02f0-4a8d-94aa-e1abfeff2388 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:17.735231 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-63fcbd4e-02f0-4a8d-94aa-e1abfeff2388 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:17.892724 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-63fcbd4e-02f0-4a8d-94aa-e1abfeff2388 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:27:17.900866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-63fcbd4e-02f0-4a8d-94aa-e1abfeff2388 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1673 microversion: 2.1 time: 0.178865 Jun 16 16:27:17.901435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 615/1230] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:27:17 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:27:18.918855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-bc7bb547-6221-41a4-b568-04dd6e007638 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:18.919558 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-bc7bb547-6221-41a4-b568-04dd6e007638 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:27:18.926593 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bc7bb547-6221-41a4-b568-04dd6e007638 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:18.927045 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bc7bb547-6221-41a4-b568-04dd6e007638 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:18.927820 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bc7bb547-6221-41a4-b568-04dd6e007638 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:18.928257 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-bc7bb547-6221-41a4-b568-04dd6e007638 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:19.068382 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-bc7bb547-6221-41a4-b568-04dd6e007638 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:27:19.076135 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-bc7bb547-6221-41a4-b568-04dd6e007638 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1673 microversion: 2.1 time: 0.161558 Jun 16 16:27:19.076792 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 616/1231] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:27:18 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:27:20.094030 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-97260c8b-3511-48fb-bca9-78afc89115f2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:20.094620 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-97260c8b-3511-48fb-bca9-78afc89115f2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:27:20.101344 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-97260c8b-3511-48fb-bca9-78afc89115f2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:20.101816 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-97260c8b-3511-48fb-bca9-78afc89115f2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:20.102580 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-97260c8b-3511-48fb-bca9-78afc89115f2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:20.103010 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-97260c8b-3511-48fb-bca9-78afc89115f2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:20.231518 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-97260c8b-3511-48fb-bca9-78afc89115f2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:27:20.238991 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-97260c8b-3511-48fb-bca9-78afc89115f2 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1673 microversion: 2.1 time: 0.148925 Jun 16 16:27:20.239559 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 616/1232] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:27:20 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:27:21.256425 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a42e8219-bef6-4211-950c-67e8774ab13f tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:21.257034 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a42e8219-bef6-4211-950c-67e8774ab13f tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:27:21.264227 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a42e8219-bef6-4211-950c-67e8774ab13f tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:21.264670 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a42e8219-bef6-4211-950c-67e8774ab13f tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:21.265422 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a42e8219-bef6-4211-950c-67e8774ab13f tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:21.265881 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a42e8219-bef6-4211-950c-67e8774ab13f tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:21.395647 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a42e8219-bef6-4211-950c-67e8774ab13f tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:27:21.403206 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a42e8219-bef6-4211-950c-67e8774ab13f tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1673 microversion: 2.1 time: 0.150512 Jun 16 16:27:21.403756 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 617/1233] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:27:21 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:27:22.422093 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-042c93f0-bbec-43c4-80c6-c32b57b3a5e7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:22.422093 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-042c93f0-bbec-43c4-80c6-c32b57b3a5e7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:27:22.427154 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-042c93f0-bbec-43c4-80c6-c32b57b3a5e7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:22.427596 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-042c93f0-bbec-43c4-80c6-c32b57b3a5e7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:22.428353 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-042c93f0-bbec-43c4-80c6-c32b57b3a5e7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:22.428789 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-042c93f0-bbec-43c4-80c6-c32b57b3a5e7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:22.555828 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-042c93f0-bbec-43c4-80c6-c32b57b3a5e7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:27:22.563884 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-042c93f0-bbec-43c4-80c6-c32b57b3a5e7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1673 microversion: 2.1 time: 0.147672 Jun 16 16:27:22.564455 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 617/1234] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:27:22 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:27:23.582940 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-68b66df0-2a9d-4ab8-af6d-d1e5197306ec tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:23.584709 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-68b66df0-2a9d-4ab8-af6d-d1e5197306ec tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:27:23.595237 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-68b66df0-2a9d-4ab8-af6d-d1e5197306ec tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:23.595885 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-68b66df0-2a9d-4ab8-af6d-d1e5197306ec tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:23.597059 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-68b66df0-2a9d-4ab8-af6d-d1e5197306ec tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:23.597662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-68b66df0-2a9d-4ab8-af6d-d1e5197306ec tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:24.335029 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-68b66df0-2a9d-4ab8-af6d-d1e5197306ec tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:27:24.342462 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-68b66df0-2a9d-4ab8-af6d-d1e5197306ec tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 200 len: 1673 microversion: 2.1 time: 0.766065 Jun 16 16:27:24.343039 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 618/1235] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:27:23 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 1673 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:27:24.534736 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-cd061789-1dca-4847-bd32-5c047019ab9b req-c97b2578-ab78-4abb-9b21-0739fbfe00f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0f7646-c731-405a-ac41-0e889b5fdb56", "name": "network-vif-deleted", "tag": "fb44d1d7-b555-4a7c-9246-8f035d594d28"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:27:24.549484 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-cd061789-1dca-4847-bd32-5c047019ab9b req-c97b2578-ab78-4abb-9b21-0739fbfe00f2 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:24.550101 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-cd061789-1dca-4847-bd32-5c047019ab9b req-c97b2578-ab78-4abb-9b21-0739fbfe00f2 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:24.582762 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-cd061789-1dca-4847-bd32-5c047019ab9b req-c97b2578-ab78-4abb-9b21-0739fbfe00f2 service nova] Creating event network-vif-deleted:fb44d1d7-b555-4a7c-9246-8f035d594d28 for instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 on hv-cinder-83735 Jun 16 16:27:24.593711 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-cd061789-1dca-4847-bd32-5c047019ab9b req-c97b2578-ab78-4abb-9b21-0739fbfe00f2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062438 Jun 16 16:27:24.594354 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 618/1236] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:27:25.360143 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9a6b5d13-df01-4edd-b309-869d4d01eb59 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:25.360756 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9a6b5d13-df01-4edd-b309-869d4d01eb59 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:27:25.367603 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9a6b5d13-df01-4edd-b309-869d4d01eb59 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:25.368049 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9a6b5d13-df01-4edd-b309-869d4d01eb59 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:25.368807 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9a6b5d13-df01-4edd-b309-869d4d01eb59 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:25.369421 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9a6b5d13-df01-4edd-b309-869d4d01eb59 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:25.383962 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-9a6b5d13-df01-4edd-b309-869d4d01eb59 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] HTTP exception thrown: Instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 could not be found. Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9a6b5d13-df01-4edd-b309-869d4d01eb59 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Request method failure captured: Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 HTTP/1.1 Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1iYjYC_t6EwK1D26TF8cExWvwcMMl8sM1bZOzgw1iMuPmBOfAYyhFDyEwheYCjuoVAGA_E-hRBQWuPx_miciHdaR2FD4tx0ylJ7iDH3par9-6UIWuJzw-O969-gztmcvty2xvaiq9tZ-UiekiBdjdmcgd_91UvWbb3zCoNFpsUWdsQ Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: 41f6c4a1b7784d7d874b00d5e43507cf Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeTestJSON-99850122 Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:27:25.385662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:27:25.387407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/41f6c4a1b7784d7d874b00d5e43507cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/41f6c4a1b7784d7d874b00d5e43507cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_41f6c4a1b7784d7d874b00d5e43507cf", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/41f6c4a1b7784d7d874b00d5e43507cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:27:25.387407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeTestJSON-99850122 Jun 16 16:27:25.387407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 41f6c4a1b7784d7d874b00d5e43507cf Jun 16 16:27:25.387407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeTestJSON-99850122 Jun 16 16:27:25.387407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeTestJSON-99850122-project Jun 16 16:27:25.387407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:27:25.387407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:27:25.387407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: c6c53bf1554a4825afd8770ea9347ad1 Jun 16 16:27:25.387407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeTestJSON-99850122-project Jun 16 16:27:25.387407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:27:25.387407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 could not be found. Jun 16 16:27:25.387407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '3b0f7646-c731-405a-ac41-0e889b5fdb56'} Jun 16 16:27:25.391788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:27:25.391788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:27:25.391788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:27:25.391788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:27:25.391788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:27:25.391788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:27:25.391788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:27:25.391788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:27:25.391788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:27:25.391788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:27:25.391788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 could not be found. Jun 16 16:27:25.391788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:27:25.391788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:27:25.391788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:27:25.391788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:27:25.391788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:27:25.391788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:27:25.391788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:27:25.391788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:27:25.391788 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:27:25.393242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:27:25.393242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:27:25.393242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:27:25.393242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:27:25.393242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:27:25.393242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:27:25.393242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:27:25.393242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 could not be found. Jun 16 16:27:25.393242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:27:25.393242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:27:25.393242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:27:25.393242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:27:25.393242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:27:25.393242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:27:25.393242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:27:25.393242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:27:25.393242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 could not be found. Jun 16 16:27:25.393242 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:27:25.394506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9a6b5d13-df01-4edd-b309-869d4d01eb59 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Returning 404 to user: Instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:27:25.394506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9a6b5d13-df01-4edd-b309-869d4d01eb59 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 404 len: 111 microversion: 2.1 time: 0.030738 Jun 16 16:27:25.394506 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 619/1237] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:27:25 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:27:25.396540 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9402f5fd-e609-4ccf-828b-00b44c70bf46 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '.version_select at 0x7f6f0d1598b0>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:25.399757 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9402f5fd-e609-4ccf-828b-00b44c70bf46 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [324d98b2-795b-4a45-b0d9-9845d1b2aeb8] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 16:27:26.410862 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO oslo.messaging._drivers.impl_rabbit [None req-9402f5fd-e609-4ccf-828b-00b44c70bf46 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [324d98b2-795b-4a45-b0d9-9845d1b2aeb8] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 36128. Jun 16 16:27:26.428115 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9402f5fd-e609-4ccf-828b-00b44c70bf46 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-171472634" status: 202 len: 0 microversion: 2.1 time: 1.035698 Jun 16 16:27:26.428698 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 619/1238] 10.222.0.88 () {58 vars in 1217 bytes} [Thu Jun 16 16:27:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-171472634 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:27:27.041891 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-641e1899-d49d-49c3-b827-14b91795b24d tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Action: 'create', calling method: .version_select at 0x7f6f118334c0>, body: {"keypair": {"name": "tempest-keypair-950793368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhT0CDdZJ5Ry1HCEinqoNIkxHfq7Mtr7o4RoLK/NVsvKCq7Nk7FhC6mFkmt+HwkWx9qNvt/hNnPO3NPSfXBkXXeljE8i79kgaAUlNlXYzNqU8IT0XQAFV+cwPM+TewJAg=="}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:27:27.056187 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-641e1899-d49d-49c3-b827-14b91795b24d tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Getting quotas for project 41f6c4a1b7784d7d874b00d5e43507cf. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:27:27.059993 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-641e1899-d49d-49c3-b827-14b91795b24d tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Getting quotas for user c6c53bf1554a4825afd8770ea9347ad1 and project 41f6c4a1b7784d7d874b00d5e43507cf. Resources: {'key_pairs'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:27:27.071324 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR oslo.messaging._drivers.impl_rabbit [None req-641e1899-d49d-49c3-b827-14b91795b24d tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [d37c399d-08da-42f3-8e34-5d7c4fa0c600] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 16:27:28.078545 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [None req-641e1899-d49d-49c3-b827-14b91795b24d tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [d37c399d-08da-42f3-8e34-5d7c4fa0c600] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 36144. Jun 16 16:27:28.092692 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-641e1899-d49d-49c3-b827-14b91795b24d tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.054719 Jun 16 16:27:28.093276 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 620/1239] 10.222.0.88 () {60 vars in 1158 bytes} [Thu Jun 16 16:27:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:27:29.310689 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0fed7c71-21cd-4dee-870e-ad6ed4eaf5b5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2012821669", "imageRef": "d2716dc1-3d4d-4f62-b0af-c38986f2a3aa", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45ef15c7-612b-46f3-8f14-2e68fe914c36"}], "security_groups": [{"name": "tempest-securitygroup--699147071"}], "key_name": "tempest-keypair-950793368", "user_data": "}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:27:29.507701 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-0fed7c71-21cd-4dee-870e-ad6ed4eaf5b5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] validate_networks() for [('45ef15c7-612b-46f3-8f14-2e68fe914c36', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:27:29.868775 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-0fed7c71-21cd-4dee-870e-ad6ed4eaf5b5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:27:29.869197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-0fed7c71-21cd-4dee-870e-ad6ed4eaf5b5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:27:29.869673 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-0fed7c71-21cd-4dee-870e-ad6ed4eaf5b5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:27:29.870659 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-0fed7c71-21cd-4dee-870e-ad6ed4eaf5b5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:27:29.871068 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-0fed7c71-21cd-4dee-870e-ad6ed4eaf5b5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:27:29.879878 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0fed7c71-21cd-4dee-870e-ad6ed4eaf5b5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:29.880326 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0fed7c71-21cd-4dee-870e-ad6ed4eaf5b5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:29.881120 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0fed7c71-21cd-4dee-870e-ad6ed4eaf5b5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:29.881556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0fed7c71-21cd-4dee-870e-ad6ed4eaf5b5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:29.898498 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-0fed7c71-21cd-4dee-870e-ad6ed4eaf5b5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Getting quotas for project 41f6c4a1b7784d7d874b00d5e43507cf. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:27:29.903079 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-0fed7c71-21cd-4dee-870e-ad6ed4eaf5b5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Getting quotas for user c6c53bf1554a4825afd8770ea9347ad1 and project 41f6c4a1b7784d7d874b00d5e43507cf. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:27:29.913934 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0fed7c71-21cd-4dee-870e-ad6ed4eaf5b5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:27:29.916275 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0fed7c71-21cd-4dee-870e-ad6ed4eaf5b5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2716dc1-3d4d-4f62-b0af-c38986f2a3aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:27:29.963535 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0fed7c71-21cd-4dee-870e-ad6ed4eaf5b5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.658250 Jun 16 16:27:29.964969 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 620/1240] 10.222.0.88 () {60 vars in 1146 bytes} [Thu Jun 16 16:27:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:27:29.975379 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-639de42d-1bc8-45d6-9025-05316022790d tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:29.976000 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-639de42d-1bc8-45d6-9025-05316022790d tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:27:30.029052 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-639de42d-1bc8-45d6-9025-05316022790d tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:27:30.035622 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-639de42d-1bc8-45d6-9025-05316022790d tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7" status: 200 len: 1237 microversion: 2.1 time: 0.064829 Jun 16 16:27:30.036532 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 621/1241] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:27:29 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:27:31.055283 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-929f0a0e-c186-4fe4-a8fa-ea47ad7ca5ea tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:31.056061 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-929f0a0e-c186-4fe4-a8fa-ea47ad7ca5ea tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:27:31.068423 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-929f0a0e-c186-4fe4-a8fa-ea47ad7ca5ea tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:31.070757 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-929f0a0e-c186-4fe4-a8fa-ea47ad7ca5ea tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:31.071654 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-929f0a0e-c186-4fe4-a8fa-ea47ad7ca5ea tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:31.072276 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-929f0a0e-c186-4fe4-a8fa-ea47ad7ca5ea tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:31.162242 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-929f0a0e-c186-4fe4-a8fa-ea47ad7ca5ea tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:27:31.172512 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-929f0a0e-c186-4fe4-a8fa-ea47ad7ca5ea tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7" status: 200 len: 1295 microversion: 2.1 time: 0.121443 Jun 16 16:27:31.173480 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 621/1242] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:27:31 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 => generated 1295 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:27:32.189992 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-37f7ac23-b32f-43bc-ae25-7d1195a28ce7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:32.190632 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-37f7ac23-b32f-43bc-ae25-7d1195a28ce7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:27:32.197595 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-37f7ac23-b32f-43bc-ae25-7d1195a28ce7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:32.198125 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-37f7ac23-b32f-43bc-ae25-7d1195a28ce7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:32.198899 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-37f7ac23-b32f-43bc-ae25-7d1195a28ce7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:32.199333 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-37f7ac23-b32f-43bc-ae25-7d1195a28ce7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:32.444470 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-079c18bf-066a-4234-b54a-ae916765d971 req-b31fb34e-c987-49de-831b-1e14e9d2a8df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04ee4e81-9700-4e68-8206-ef3f08d9f8b7", "tag": "7fb6e4e3-160e-41a2-acba-acecfd3f19bc"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:27:32.460953 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-079c18bf-066a-4234-b54a-ae916765d971 req-b31fb34e-c987-49de-831b-1e14e9d2a8df service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:32.461697 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-37f7ac23-b32f-43bc-ae25-7d1195a28ce7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:27:32.462199 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-079c18bf-066a-4234-b54a-ae916765d971 req-b31fb34e-c987-49de-831b-1e14e9d2a8df service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:32.485642 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-079c18bf-066a-4234-b54a-ae916765d971 req-b31fb34e-c987-49de-831b-1e14e9d2a8df service nova] Creating event network-changed:7fb6e4e3-160e-41a2-acba-acecfd3f19bc for instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 on hv-cinder-83735 Jun 16 16:27:32.488459 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-079c18bf-066a-4234-b54a-ae916765d971 req-b31fb34e-c987-49de-831b-1e14e9d2a8df service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048576 Jun 16 16:27:32.489848 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 622/1243] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:27:32.493634 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-37f7ac23-b32f-43bc-ae25-7d1195a28ce7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7" status: 200 len: 1362 microversion: 2.1 time: 0.307563 Jun 16 16:27:32.505907 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 622/1244] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:27:32 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:27:33.512912 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-da079380-7242-4b53-97f4-dfd6937ec5be tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:33.513605 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-da079380-7242-4b53-97f4-dfd6937ec5be tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:27:33.519778 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-da079380-7242-4b53-97f4-dfd6937ec5be tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:33.520331 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-da079380-7242-4b53-97f4-dfd6937ec5be tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:33.521094 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-da079380-7242-4b53-97f4-dfd6937ec5be tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:33.521529 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-da079380-7242-4b53-97f4-dfd6937ec5be tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:33.656800 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-da079380-7242-4b53-97f4-dfd6937ec5be tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:27:33.664305 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-da079380-7242-4b53-97f4-dfd6937ec5be tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7" status: 200 len: 1362 microversion: 2.1 time: 0.156180 Jun 16 16:27:33.664880 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 623/1245] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:27:33 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:27:34.682421 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fa5d85cd-3365-4c2f-9e7e-ddf23e44abcd tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:34.683267 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fa5d85cd-3365-4c2f-9e7e-ddf23e44abcd tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:27:34.690223 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fa5d85cd-3365-4c2f-9e7e-ddf23e44abcd tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:34.690666 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fa5d85cd-3365-4c2f-9e7e-ddf23e44abcd tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:34.691631 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fa5d85cd-3365-4c2f-9e7e-ddf23e44abcd tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:34.692257 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fa5d85cd-3365-4c2f-9e7e-ddf23e44abcd tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:34.841463 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fa5d85cd-3365-4c2f-9e7e-ddf23e44abcd tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:27:34.849137 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fa5d85cd-3365-4c2f-9e7e-ddf23e44abcd tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7" status: 200 len: 1362 microversion: 2.1 time: 0.171389 Jun 16 16:27:34.849708 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 623/1246] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:27:34 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:27:35.865570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-555e7ddb-d9e8-4a20-849d-ce6f3eb4a92b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:35.866218 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-555e7ddb-d9e8-4a20-849d-ce6f3eb4a92b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:27:35.872797 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-555e7ddb-d9e8-4a20-849d-ce6f3eb4a92b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:35.873247 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-555e7ddb-d9e8-4a20-849d-ce6f3eb4a92b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:35.874049 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-555e7ddb-d9e8-4a20-849d-ce6f3eb4a92b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:35.874485 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-555e7ddb-d9e8-4a20-849d-ce6f3eb4a92b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:36.004609 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-555e7ddb-d9e8-4a20-849d-ce6f3eb4a92b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:27:36.012539 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-555e7ddb-d9e8-4a20-849d-ce6f3eb4a92b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7" status: 200 len: 1362 microversion: 2.1 time: 0.150750 Jun 16 16:27:36.013102 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 624/1247] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:27:35 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:27:37.030509 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e4f0f6f4-9817-42c0-8aba-0d2961a3f963 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:37.031232 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e4f0f6f4-9817-42c0-8aba-0d2961a3f963 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:27:37.038236 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e4f0f6f4-9817-42c0-8aba-0d2961a3f963 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:37.038714 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e4f0f6f4-9817-42c0-8aba-0d2961a3f963 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:37.039476 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e4f0f6f4-9817-42c0-8aba-0d2961a3f963 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:37.039958 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e4f0f6f4-9817-42c0-8aba-0d2961a3f963 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:37.179502 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e4f0f6f4-9817-42c0-8aba-0d2961a3f963 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:27:37.187984 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e4f0f6f4-9817-42c0-8aba-0d2961a3f963 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7" status: 200 len: 1362 microversion: 2.1 time: 0.161979 Jun 16 16:27:37.192732 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 624/1248] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:27:37 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:27:38.204305 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-901cde90-a831-4102-8b0c-05ee843b995a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:38.204911 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-901cde90-a831-4102-8b0c-05ee843b995a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:27:38.211307 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-901cde90-a831-4102-8b0c-05ee843b995a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:38.211747 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-901cde90-a831-4102-8b0c-05ee843b995a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:38.212494 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-901cde90-a831-4102-8b0c-05ee843b995a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:38.212923 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-901cde90-a831-4102-8b0c-05ee843b995a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:38.346558 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-901cde90-a831-4102-8b0c-05ee843b995a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:27:38.353913 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-901cde90-a831-4102-8b0c-05ee843b995a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7" status: 200 len: 1362 microversion: 2.1 time: 0.153371 Jun 16 16:27:38.355036 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 625/1249] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:27:38 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:27:38.419781 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-6ef4bb24-76b3-482a-8ec2-f6a5f6ec9a4a req-3c18a94e-f5a5-4fb1-b78a-40e6f32ca223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ee4e81-9700-4e68-8206-ef3f08d9f8b7", "name": "network-vif-plugged", "status": "completed", "tag": "7fb6e4e3-160e-41a2-acba-acecfd3f19bc"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:27:38.428363 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-6ef4bb24-76b3-482a-8ec2-f6a5f6ec9a4a req-3c18a94e-f5a5-4fb1-b78a-40e6f32ca223 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:38.429021 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-6ef4bb24-76b3-482a-8ec2-f6a5f6ec9a4a req-3c18a94e-f5a5-4fb1-b78a-40e6f32ca223 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:38.440236 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-6ef4bb24-76b3-482a-8ec2-f6a5f6ec9a4a req-3c18a94e-f5a5-4fb1-b78a-40e6f32ca223 service nova] Creating event network-vif-plugged:7fb6e4e3-160e-41a2-acba-acecfd3f19bc for instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 on hv-cinder-83735 Jun 16 16:27:38.445386 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-6ef4bb24-76b3-482a-8ec2-f6a5f6ec9a4a req-3c18a94e-f5a5-4fb1-b78a-40e6f32ca223 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029836 Jun 16 16:27:38.446471 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 625/1250] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:27:39.371815 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c230f1cd-3068-4c29-a6b9-fdc5b72b529a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:39.372421 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c230f1cd-3068-4c29-a6b9-fdc5b72b529a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:27:39.378843 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c230f1cd-3068-4c29-a6b9-fdc5b72b529a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:39.379284 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c230f1cd-3068-4c29-a6b9-fdc5b72b529a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:39.380034 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c230f1cd-3068-4c29-a6b9-fdc5b72b529a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:39.380465 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c230f1cd-3068-4c29-a6b9-fdc5b72b529a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:39.508691 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c230f1cd-3068-4c29-a6b9-fdc5b72b529a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:27:39.515925 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c230f1cd-3068-4c29-a6b9-fdc5b72b529a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7" status: 200 len: 1362 microversion: 2.1 time: 0.148530 Jun 16 16:27:39.516491 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 626/1251] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:27:39 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:27:40.530704 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=6 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:40.535012 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-874996b8-0ab1-4ac2-8560-3a79c2b36207 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:40.535714 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-874996b8-0ab1-4ac2-8560-3a79c2b36207 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:27:40.542183 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-874996b8-0ab1-4ac2-8560-3a79c2b36207 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:40.542632 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-874996b8-0ab1-4ac2-8560-3a79c2b36207 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:40.543383 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-874996b8-0ab1-4ac2-8560-3a79c2b36207 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:40.543849 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-874996b8-0ab1-4ac2-8560-3a79c2b36207 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:40.676899 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-874996b8-0ab1-4ac2-8560-3a79c2b36207 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:27:40.685155 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-874996b8-0ab1-4ac2-8560-3a79c2b36207 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7" status: 200 len: 1549 microversion: 2.1 time: 0.155902 Jun 16 16:27:40.685797 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 626/1252] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:27:40 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:27:40.701859 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a488e406-4323-4650-b998-1166dce89541 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:27:40.702394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a488e406-4323-4650-b998-1166dce89541 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:27:40.705221 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:40.705911 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=6 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:40.711152 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a488e406-4323-4650-b998-1166dce89541 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:40.711597 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a488e406-4323-4650-b998-1166dce89541 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:40.712362 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a488e406-4323-4650-b998-1166dce89541 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:40.712797 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a488e406-4323-4650-b998-1166dce89541 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:40.787972 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a488e406-4323-4650-b998-1166dce89541 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090354 Jun 16 16:27:40.788569 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 627/1253] 10.222.0.88 () {58 vars in 1274 bytes} [Thu Jun 16 16:27:40 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:27:42.347039 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-a49870d7-a964-4905-8917-5870198cc690 req-19c532b9-bf95-42c1-9b96-bcb76161351c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04ee4e81-9700-4e68-8206-ef3f08d9f8b7", "tag": "7fb6e4e3-160e-41a2-acba-acecfd3f19bc"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:27:42.358148 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-a49870d7-a964-4905-8917-5870198cc690 req-19c532b9-bf95-42c1-9b96-bcb76161351c service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:27:42.358599 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-a49870d7-a964-4905-8917-5870198cc690 req-19c532b9-bf95-42c1-9b96-bcb76161351c service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:27:42.370256 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-a49870d7-a964-4905-8917-5870198cc690 req-19c532b9-bf95-42c1-9b96-bcb76161351c service nova] Creating event network-changed:7fb6e4e3-160e-41a2-acba-acecfd3f19bc for instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 on hv-cinder-83735 Jun 16 16:27:42.375563 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-a49870d7-a964-4905-8917-5870198cc690 req-19c532b9-bf95-42c1-9b96-bcb76161351c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033031 Jun 16 16:27:42.376158 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 627/1254] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:27:45.410579 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:27:45.411121 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Thu Jun 16 16:27:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:29:08.968360 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:29:08.969202 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=64 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:29:08.974101 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-fc8d8a8d-af3c-4751-886d-aefdf31aa74a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:08.974588 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-fc8d8a8d-af3c-4751-886d-aefdf31aa74a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:08.981649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fc8d8a8d-af3c-4751-886d-aefdf31aa74a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:08.982117 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fc8d8a8d-af3c-4751-886d-aefdf31aa74a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:08.982869 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fc8d8a8d-af3c-4751-886d-aefdf31aa74a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:08.983296 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-fc8d8a8d-af3c-4751-886d-aefdf31aa74a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:09.011238 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-fc8d8a8d-af3c-4751-886d-aefdf31aa74a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/ips" status: 200 len: 146 microversion: 2.1 time: 0.044380 Jun 16 16:29:09.012288 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 628/1255] 10.222.0.88 () {58 vars in 1247 bytes} [Thu Jun 16 16:29:08 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:29:10.330769 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:29:10.331617 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:29:10.336848 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-535f7c7c-f0a8-4b62-bf32-cb19a73b8efd tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1276d60-cc09-493d-b609-cd408a772ca3"}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:29:10.338008 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-535f7c7c-f0a8-4b62-bf32-cb19a73b8efd tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:10.345828 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-535f7c7c-f0a8-4b62-bf32-cb19a73b8efd tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:10.346269 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-535f7c7c-f0a8-4b62-bf32-cb19a73b8efd tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:10.347016 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-535f7c7c-f0a8-4b62-bf32-cb19a73b8efd tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:10.347443 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-535f7c7c-f0a8-4b62-bf32-cb19a73b8efd tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:10.608906 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-535f7c7c-f0a8-4b62-bf32-cb19a73b8efd tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "POST /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280026 Jun 16 16:29:10.609514 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 628/1256] 10.222.0.88 () {60 vars in 1322 bytes} [Thu Jun 16 16:29:10 2022] POST /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:29:18.138261 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-2e2a9109-db44-4a9a-ae4c-593b4a40055b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:18.140677 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-2e2a9109-db44-4a9a-ae4c-593b4a40055b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:18.148702 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2e2a9109-db44-4a9a-ae4c-593b4a40055b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:18.149756 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2e2a9109-db44-4a9a-ae4c-593b4a40055b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:18.150564 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2e2a9109-db44-4a9a-ae4c-593b4a40055b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:18.150994 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-2e2a9109-db44-4a9a-ae4c-593b4a40055b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:18.181466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-2e2a9109-db44-4a9a-ae4c-593b4a40055b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050014 Jun 16 16:29:18.182105 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 629/1257] 10.222.0.88 () {58 vars in 1301 bytes} [Thu Jun 16 16:29:18 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:29:18.193219 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-eff30ed2-490e-402d-99ef-1c109333a02b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:18.193825 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-eff30ed2-490e-402d-99ef-1c109333a02b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:18.200999 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eff30ed2-490e-402d-99ef-1c109333a02b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:18.201441 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eff30ed2-490e-402d-99ef-1c109333a02b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:18.202219 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eff30ed2-490e-402d-99ef-1c109333a02b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:18.202643 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eff30ed2-490e-402d-99ef-1c109333a02b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:18.234993 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-eff30ed2-490e-402d-99ef-1c109333a02b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments/a1276d60-cc09-493d-b609-cd408a772ca3" status: 200 len: 194 microversion: 2.1 time: 0.046430 Jun 16 16:29:18.235601 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 629/1258] 10.222.0.88 () {58 vars in 1412 bytes} [Thu Jun 16 16:29:18 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments/a1276d60-cc09-493d-b609-cd408a772ca3 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:29:19.584039 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-40e1e89f-d20c-4c5c-9ca9-a1ae2a741da7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4fe7dde-ae0d-47e7-9baa-0436fed28e5a"}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:29:19.585083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-40e1e89f-d20c-4c5c-9ca9-a1ae2a741da7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:19.592578 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-40e1e89f-d20c-4c5c-9ca9-a1ae2a741da7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:19.593063 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-40e1e89f-d20c-4c5c-9ca9-a1ae2a741da7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:19.593890 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-40e1e89f-d20c-4c5c-9ca9-a1ae2a741da7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:19.596855 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-40e1e89f-d20c-4c5c-9ca9-a1ae2a741da7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:19.885443 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-40e1e89f-d20c-4c5c-9ca9-a1ae2a741da7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "POST /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305276 Jun 16 16:29:19.886067 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 630/1259] 10.222.0.88 () {60 vars in 1322 bytes} [Thu Jun 16 16:29:19 2022] POST /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:29:27.421372 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-95f692e8-65c3-4059-93fa-e0aa66b0e63b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:27.422333 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-95f692e8-65c3-4059-93fa-e0aa66b0e63b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:27.428897 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-95f692e8-65c3-4059-93fa-e0aa66b0e63b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:27.429379 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-95f692e8-65c3-4059-93fa-e0aa66b0e63b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:27.430352 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-95f692e8-65c3-4059-93fa-e0aa66b0e63b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:27.430833 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-95f692e8-65c3-4059-93fa-e0aa66b0e63b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:27.460420 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-95f692e8-65c3-4059-93fa-e0aa66b0e63b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042873 Jun 16 16:29:27.460984 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 630/1260] 10.222.0.88 () {58 vars in 1301 bytes} [Thu Jun 16 16:29:27 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:29:27.604818 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9645d30d-cd17-43ed-9b3b-d96580a7d8a5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:27.605414 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9645d30d-cd17-43ed-9b3b-d96580a7d8a5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:27.611570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9645d30d-cd17-43ed-9b3b-d96580a7d8a5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:27.612015 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9645d30d-cd17-43ed-9b3b-d96580a7d8a5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:27.612776 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9645d30d-cd17-43ed-9b3b-d96580a7d8a5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:27.613212 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9645d30d-cd17-43ed-9b3b-d96580a7d8a5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:27.645866 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9645d30d-cd17-43ed-9b3b-d96580a7d8a5 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments/a1276d60-cc09-493d-b609-cd408a772ca3" status: 200 len: 194 microversion: 2.1 time: 0.046134 Jun 16 16:29:27.646426 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 631/1261] 10.222.0.88 () {58 vars in 1412 bytes} [Thu Jun 16 16:29:27 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments/a1276d60-cc09-493d-b609-cd408a772ca3 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:29:27.657971 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1c2fcd70-2cc6-40d6-ba06-ef864c1a17cf tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:27.658466 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1c2fcd70-2cc6-40d6-ba06-ef864c1a17cf tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:27.664581 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1c2fcd70-2cc6-40d6-ba06-ef864c1a17cf tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:27.665034 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1c2fcd70-2cc6-40d6-ba06-ef864c1a17cf tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:27.665829 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1c2fcd70-2cc6-40d6-ba06-ef864c1a17cf tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:27.666266 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1c2fcd70-2cc6-40d6-ba06-ef864c1a17cf tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:27.748978 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-1c2fcd70-2cc6-40d6-ba06-ef864c1a17cf tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lazy-loading 'services' on Instance uuid 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:29:27.829229 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1c2fcd70-2cc6-40d6-ba06-ef864c1a17cf tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "DELETE /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments/a1276d60-cc09-493d-b609-cd408a772ca3" status: 202 len: 0 microversion: 2.1 time: 0.175559 Jun 16 16:29:27.829998 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 631/1262] 10.222.0.88 () {58 vars in 1415 bytes} [Thu Jun 16 16:29:27 2022] DELETE /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments/a1276d60-cc09-493d-b609-cd408a772ca3 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:29:30.000120 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7f1dd973-6b7f-4376-88a7-284f0ce7e46d tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:30.001043 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7f1dd973-6b7f-4376-88a7-284f0ce7e46d tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:30.010137 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7f1dd973-6b7f-4376-88a7-284f0ce7e46d tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:30.010792 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7f1dd973-6b7f-4376-88a7-284f0ce7e46d tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:30.011940 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7f1dd973-6b7f-4376-88a7-284f0ce7e46d tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:30.012492 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7f1dd973-6b7f-4376-88a7-284f0ce7e46d tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:30.050416 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7f1dd973-6b7f-4376-88a7-284f0ce7e46d tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments/a4fe7dde-ae0d-47e7-9baa-0436fed28e5a" status: 200 len: 194 microversion: 2.1 time: 0.054001 Jun 16 16:29:30.051311 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 632/1263] 10.222.0.88 () {58 vars in 1412 bytes} [Thu Jun 16 16:29:29 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments/a4fe7dde-ae0d-47e7-9baa-0436fed28e5a => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:29:30.063231 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4f51e6bb-c4ac-414f-927a-aba2da283f01 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:30.063833 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4f51e6bb-c4ac-414f-927a-aba2da283f01 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:30.071117 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4f51e6bb-c4ac-414f-927a-aba2da283f01 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:30.071594 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4f51e6bb-c4ac-414f-927a-aba2da283f01 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:30.072400 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4f51e6bb-c4ac-414f-927a-aba2da283f01 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:30.072882 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4f51e6bb-c4ac-414f-927a-aba2da283f01 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:30.173764 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-4f51e6bb-c4ac-414f-927a-aba2da283f01 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lazy-loading 'services' on Instance uuid 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:29:30.251675 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4f51e6bb-c4ac-414f-927a-aba2da283f01 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "DELETE /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments/a4fe7dde-ae0d-47e7-9baa-0436fed28e5a" status: 202 len: 0 microversion: 2.1 time: 0.193361 Jun 16 16:29:30.252346 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 632/1264] 10.222.0.88 () {58 vars in 1415 bytes} [Thu Jun 16 16:29:30 2022] DELETE /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments/a4fe7dde-ae0d-47e7-9baa-0436fed28e5a => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:29:31.430562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-4e4554cc-cf5f-4d54-9c7c-86e78e8a10e9 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:31.431738 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-4e4554cc-cf5f-4d54-9c7c-86e78e8a10e9 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:31.439070 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4e4554cc-cf5f-4d54-9c7c-86e78e8a10e9 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:31.439525 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4e4554cc-cf5f-4d54-9c7c-86e78e8a10e9 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:31.440317 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4e4554cc-cf5f-4d54-9c7c-86e78e8a10e9 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:31.440757 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-4e4554cc-cf5f-4d54-9c7c-86e78e8a10e9 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:31.471292 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-4e4554cc-cf5f-4d54-9c7c-86e78e8a10e9 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046525 Jun 16 16:29:31.471890 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 633/1265] 10.222.0.88 () {58 vars in 1301 bytes} [Thu Jun 16 16:29:31 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 16:29:31.596244 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-55ef6343-671f-4cc2-a0b1-b7de8b44d545 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:31.599230 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-55ef6343-671f-4cc2-a0b1-b7de8b44d545 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:31.610247 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-55ef6343-671f-4cc2-a0b1-b7de8b44d545 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:31.610757 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-55ef6343-671f-4cc2-a0b1-b7de8b44d545 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:31.611708 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-55ef6343-671f-4cc2-a0b1-b7de8b44d545 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:31.612234 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-55ef6343-671f-4cc2-a0b1-b7de8b44d545 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:31.658341 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-55ef6343-671f-4cc2-a0b1-b7de8b44d545 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067973 Jun 16 16:29:31.659103 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 633/1266] 10.222.0.88 () {58 vars in 1301 bytes} [Thu Jun 16 16:29:31 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:29:31.728436 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7a413b34-4011-4d8e-b899-5bacfe3e5540 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:31.729069 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7a413b34-4011-4d8e-b899-5bacfe3e5540 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:31.736316 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7a413b34-4011-4d8e-b899-5bacfe3e5540 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:31.736862 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7a413b34-4011-4d8e-b899-5bacfe3e5540 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:31.737804 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7a413b34-4011-4d8e-b899-5bacfe3e5540 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:31.738296 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7a413b34-4011-4d8e-b899-5bacfe3e5540 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:31.767086 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7a413b34-4011-4d8e-b899-5bacfe3e5540 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:29:31.862258 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7a413b34-4011-4d8e-b899-5bacfe3e5540 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "DELETE /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7" status: 204 len: 0 microversion: 2.1 time: 0.138891 Jun 16 16:29:31.862712 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 634/1267] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:29:31 2022] DELETE /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:29:31.871691 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-95d60e24-fbf5-4e8f-bbb8-4ddf5faaba74 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:31.872296 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-95d60e24-fbf5-4e8f-bbb8-4ddf5faaba74 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:31.878290 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-95d60e24-fbf5-4e8f-bbb8-4ddf5faaba74 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:31.878732 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-95d60e24-fbf5-4e8f-bbb8-4ddf5faaba74 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:31.879475 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-95d60e24-fbf5-4e8f-bbb8-4ddf5faaba74 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:31.879901 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-95d60e24-fbf5-4e8f-bbb8-4ddf5faaba74 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:32.039533 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-95d60e24-fbf5-4e8f-bbb8-4ddf5faaba74 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:29:32.049039 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-95d60e24-fbf5-4e8f-bbb8-4ddf5faaba74 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7" status: 200 len: 1673 microversion: 2.1 time: 0.181038 Jun 16 16:29:32.049743 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 634/1268] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:29:31 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:29:33.074938 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-99a1f834-c43f-4ff0-bc3c-beb32a90fe0c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:33.075703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-99a1f834-c43f-4ff0-bc3c-beb32a90fe0c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:33.082366 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-99a1f834-c43f-4ff0-bc3c-beb32a90fe0c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:33.082817 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-99a1f834-c43f-4ff0-bc3c-beb32a90fe0c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:33.083589 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-99a1f834-c43f-4ff0-bc3c-beb32a90fe0c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:33.084027 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-99a1f834-c43f-4ff0-bc3c-beb32a90fe0c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:33.233838 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-99a1f834-c43f-4ff0-bc3c-beb32a90fe0c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:29:33.244374 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-99a1f834-c43f-4ff0-bc3c-beb32a90fe0c tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7" status: 200 len: 1673 microversion: 2.1 time: 0.173482 Jun 16 16:29:33.245155 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 635/1269] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:29:33 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:29:34.265776 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6279e424-fef7-4f7d-ab69-8bd7d4b6d41b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:34.266667 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6279e424-fef7-4f7d-ab69-8bd7d4b6d41b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:34.274426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6279e424-fef7-4f7d-ab69-8bd7d4b6d41b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:34.274983 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6279e424-fef7-4f7d-ab69-8bd7d4b6d41b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:34.275887 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6279e424-fef7-4f7d-ab69-8bd7d4b6d41b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:34.276391 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6279e424-fef7-4f7d-ab69-8bd7d4b6d41b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:34.499590 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6279e424-fef7-4f7d-ab69-8bd7d4b6d41b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:29:34.509148 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6279e424-fef7-4f7d-ab69-8bd7d4b6d41b tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7" status: 200 len: 1673 microversion: 2.1 time: 0.247783 Jun 16 16:29:34.509990 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 635/1270] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:29:34 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 => generated 1673 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:29:35.354883 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-da5bdb87-d56b-4d2e-b6ab-85a0b2a11722 req-94918eba-6b88-488c-be04-bdfdca2f6b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ee4e81-9700-4e68-8206-ef3f08d9f8b7", "name": "network-vif-deleted", "tag": "7fb6e4e3-160e-41a2-acba-acecfd3f19bc"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:29:35.366045 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-da5bdb87-d56b-4d2e-b6ab-85a0b2a11722 req-94918eba-6b88-488c-be04-bdfdca2f6b47 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:35.366491 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-da5bdb87-d56b-4d2e-b6ab-85a0b2a11722 req-94918eba-6b88-488c-be04-bdfdca2f6b47 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:35.379197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-da5bdb87-d56b-4d2e-b6ab-85a0b2a11722 req-94918eba-6b88-488c-be04-bdfdca2f6b47 service nova] Creating event network-vif-deleted:7fb6e4e3-160e-41a2-acba-acecfd3f19bc for instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 on hv-cinder-83735 Jun 16 16:29:35.384307 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-da5bdb87-d56b-4d2e-b6ab-85a0b2a11722 req-94918eba-6b88-488c-be04-bdfdca2f6b47 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214373 Jun 16 16:29:35.384961 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 636/1271] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:29:35.528721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-beed8ed6-7727-4e8c-9fc6-83be2d36bdf7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:35.529335 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-beed8ed6-7727-4e8c-9fc6-83be2d36bdf7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:35.535955 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-beed8ed6-7727-4e8c-9fc6-83be2d36bdf7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:35.536410 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-beed8ed6-7727-4e8c-9fc6-83be2d36bdf7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:35.537232 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-beed8ed6-7727-4e8c-9fc6-83be2d36bdf7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:35.537772 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-beed8ed6-7727-4e8c-9fc6-83be2d36bdf7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:35.574133 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-beed8ed6-7727-4e8c-9fc6-83be2d36bdf7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:35.574589 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-beed8ed6-7727-4e8c-9fc6-83be2d36bdf7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:35.575053 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.objects.instance [None req-beed8ed6-7727-4e8c-9fc6-83be2d36bdf7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lazy-loading 'fault' on Instance uuid 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 {{(pid=117711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:29:35.627474 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-beed8ed6-7727-4e8c-9fc6-83be2d36bdf7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c53bf1554a4825afd8770ea9347ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f6c4a1b7784d7d874b00d5e43507cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:29:35.635086 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-beed8ed6-7727-4e8c-9fc6-83be2d36bdf7 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7" status: 200 len: 1327 microversion: 2.1 time: 0.110266 Jun 16 16:29:35.635951 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 636/1272] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:29:35 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 => generated 1327 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:29:36.655441 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0c92a01d-667f-48c6-ae93-70d377b42e74 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:36.656176 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-0c92a01d-667f-48c6-ae93-70d377b42e74 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:36.663295 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0c92a01d-667f-48c6-ae93-70d377b42e74 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:36.663754 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0c92a01d-667f-48c6-ae93-70d377b42e74 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:36.665176 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0c92a01d-667f-48c6-ae93-70d377b42e74 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:36.665622 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-0c92a01d-667f-48c6-ae93-70d377b42e74 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:36.680471 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-0c92a01d-667f-48c6-ae93-70d377b42e74 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] HTTP exception thrown: Instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 could not be found. Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0c92a01d-667f-48c6-ae93-70d377b42e74 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Request method failure captured: Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 HTTP/1.1 Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1iYjYC_t6EwK1D26TF8cExWvwcMMl8sM1bZOzgw1iMuPmBOfAYyhFDyEwheYCjuoVAGA_E-hRBQWuPx_miciHdaR2FD4tx0ylJ7iDH3par9-6UIWuJzw-O969-gztmcvty2xvaiq9tZ-UiekiBdjdmcgd_91UvWbb3zCoNFpsUWdsQ Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: 41f6c4a1b7784d7d874b00d5e43507cf Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeTestJSON-99850122 Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:29:36.682192 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:29:36.683880 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/41f6c4a1b7784d7d874b00d5e43507cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/41f6c4a1b7784d7d874b00d5e43507cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_41f6c4a1b7784d7d874b00d5e43507cf", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/41f6c4a1b7784d7d874b00d5e43507cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:29:36.683880 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeTestJSON-99850122 Jun 16 16:29:36.683880 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 41f6c4a1b7784d7d874b00d5e43507cf Jun 16 16:29:36.683880 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeTestJSON-99850122 Jun 16 16:29:36.683880 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeTestJSON-99850122-project Jun 16 16:29:36.683880 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:29:36.683880 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:29:36.683880 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: c6c53bf1554a4825afd8770ea9347ad1 Jun 16 16:29:36.683880 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeTestJSON-99850122-project Jun 16 16:29:36.683880 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:29:36.683880 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 could not be found. Jun 16 16:29:36.683880 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': '04ee4e81-9700-4e68-8206-ef3f08d9f8b7'} Jun 16 16:29:36.684720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:29:36.684720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:29:36.684720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:29:36.684720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:29:36.684720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:29:36.684720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:29:36.684720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:29:36.684720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:29:36.684720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:29:36.684720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:29:36.684720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 could not be found. Jun 16 16:29:36.684720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:29:36.684720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:29:36.684720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:29:36.684720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:29:36.684720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:29:36.684720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:29:36.684720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:29:36.684720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:29:36.684720 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:29:36.686207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:29:36.686207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:29:36.686207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:29:36.686207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:29:36.686207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:29:36.686207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:29:36.686207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:29:36.686207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 could not be found. Jun 16 16:29:36.686207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:29:36.686207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:29:36.686207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:29:36.686207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:29:36.686207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:29:36.686207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:29:36.686207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:29:36.686207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:29:36.686207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 could not be found. Jun 16 16:29:36.686207 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:29:36.687402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-0c92a01d-667f-48c6-ae93-70d377b42e74 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Returning 404 to user: Instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:29:36.687402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-0c92a01d-667f-48c6-ae93-70d377b42e74 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7" status: 404 len: 111 microversion: 2.1 time: 0.032935 Jun 16 16:29:36.687402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 637/1273] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:29:36 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:29:36.692731 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-c9f69504-75c7-4022-9d57-c1ed68abe584 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '.version_select at 0x7f6f11829ca0>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:36.711944 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-c9f69504-75c7-4022-9d57-c1ed68abe584 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-950793368" status: 202 len: 0 microversion: 2.1 time: 0.022632 Jun 16 16:29:36.712593 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 637/1274] 10.222.0.88 () {58 vars in 1217 bytes} [Thu Jun 16 16:29:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-950793368 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:29:39.695568 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b9c39cda-59b7-4d17-91f4-b8b8856c7145 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:39.696197 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b9c39cda-59b7-4d17-91f4-b8b8856c7145 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:39.698520 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:29:39.703941 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b9c39cda-59b7-4d17-91f4-b8b8856c7145 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:39.704372 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b9c39cda-59b7-4d17-91f4-b8b8856c7145 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:39.705138 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b9c39cda-59b7-4d17-91f4-b8b8856c7145 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:39.705571 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b9c39cda-59b7-4d17-91f4-b8b8856c7145 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:39.709165 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:29:39.722778 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-b9c39cda-59b7-4d17-91f4-b8b8856c7145 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] HTTP exception thrown: Instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 could not be found. Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b9c39cda-59b7-4d17-91f4-b8b8856c7145 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Request method failure captured: Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: DELETE /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 HTTP/1.1 Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1iYjYC_t6EwK1D26TF8cExWvwcMMl8sM1bZOzgw1iMuPmBOfAYyhFDyEwheYCjuoVAGA_E-hRBQWuPx_miciHdaR2FD4tx0ylJ7iDH3par9-6UIWuJzw-O969-gztmcvty2xvaiq9tZ-UiekiBdjdmcgd_91UvWbb3zCoNFpsUWdsQ Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: 41f6c4a1b7784d7d874b00d5e43507cf Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeTestJSON-99850122 Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:29:39.724733 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:29:39.727006 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/41f6c4a1b7784d7d874b00d5e43507cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/41f6c4a1b7784d7d874b00d5e43507cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_41f6c4a1b7784d7d874b00d5e43507cf", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/41f6c4a1b7784d7d874b00d5e43507cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:29:39.727006 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeTestJSON-99850122 Jun 16 16:29:39.727006 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 41f6c4a1b7784d7d874b00d5e43507cf Jun 16 16:29:39.727006 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeTestJSON-99850122 Jun 16 16:29:39.727006 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeTestJSON-99850122-project Jun 16 16:29:39.727006 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:29:39.727006 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:29:39.727006 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: c6c53bf1554a4825afd8770ea9347ad1 Jun 16 16:29:39.727006 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeTestJSON-99850122-project Jun 16 16:29:39.727006 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:29:39.727006 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 could not be found. Jun 16 16:29:39.727006 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': '04ee4e81-9700-4e68-8206-ef3f08d9f8b7'} Jun 16 16:29:39.727939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:29:39.727939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:29:39.727939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:29:39.727939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:29:39.727939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:29:39.727939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:29:39.727939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:29:39.727939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:29:39.727939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:29:39.727939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:29:39.727939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 could not be found. Jun 16 16:29:39.727939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:29:39.727939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:29:39.727939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:29:39.727939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:29:39.727939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:29:39.727939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:29:39.727939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:29:39.727939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:29:39.727939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:29:39.729489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:29:39.729489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:29:39.729489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:29:39.729489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:29:39.729489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:29:39.729489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:29:39.729489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:29:39.729489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:29:39.729489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:29:39.729489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 could not be found. Jun 16 16:29:39.729489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:29:39.729489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:29:39.729489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:29:39.729489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:29:39.729489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:29:39.729489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:29:39.729489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:29:39.729489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:29:39.729489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 could not be found. Jun 16 16:29:39.729489 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:29:39.731395 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b9c39cda-59b7-4d17-91f4-b8b8856c7145 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Returning 404 to user: Instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:29:39.731395 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b9c39cda-59b7-4d17-91f4-b8b8856c7145 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "DELETE /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7" status: 404 len: 111 microversion: 2.1 time: 0.034819 Jun 16 16:29:39.731395 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 638/1275] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:29:39 2022] DELETE /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:29:39.736907 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9e02c9d0-96be-428b-8993-78b8eea2f4f0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:39.737533 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-9e02c9d0-96be-428b-8993-78b8eea2f4f0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 04ee4e81-9700-4e68-8206-ef3f08d9f8b7] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:39.745642 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9e02c9d0-96be-428b-8993-78b8eea2f4f0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:39.746130 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9e02c9d0-96be-428b-8993-78b8eea2f4f0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:39.746901 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9e02c9d0-96be-428b-8993-78b8eea2f4f0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:39.747344 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-9e02c9d0-96be-428b-8993-78b8eea2f4f0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:39.761257 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-9e02c9d0-96be-428b-8993-78b8eea2f4f0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] HTTP exception thrown: Instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 could not be found. Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9e02c9d0-96be-428b-8993-78b8eea2f4f0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Request method failure captured: Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 HTTP/1.1 Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1iYjYC_t6EwK1D26TF8cExWvwcMMl8sM1bZOzgw1iMuPmBOfAYyhFDyEwheYCjuoVAGA_E-hRBQWuPx_miciHdaR2FD4tx0ylJ7iDH3par9-6UIWuJzw-O969-gztmcvty2xvaiq9tZ-UiekiBdjdmcgd_91UvWbb3zCoNFpsUWdsQ Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: 41f6c4a1b7784d7d874b00d5e43507cf Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeTestJSON-99850122 Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:29:39.762964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:29:39.764859 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/41f6c4a1b7784d7d874b00d5e43507cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/41f6c4a1b7784d7d874b00d5e43507cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_41f6c4a1b7784d7d874b00d5e43507cf", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/41f6c4a1b7784d7d874b00d5e43507cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:29:39.764859 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeTestJSON-99850122 Jun 16 16:29:39.764859 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 41f6c4a1b7784d7d874b00d5e43507cf Jun 16 16:29:39.764859 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeTestJSON-99850122 Jun 16 16:29:39.764859 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeTestJSON-99850122-project Jun 16 16:29:39.764859 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:29:39.764859 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:29:39.764859 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: c6c53bf1554a4825afd8770ea9347ad1 Jun 16 16:29:39.764859 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeTestJSON-99850122-project Jun 16 16:29:39.764859 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:29:39.764859 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 could not be found. Jun 16 16:29:39.764859 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '04ee4e81-9700-4e68-8206-ef3f08d9f8b7'} Jun 16 16:29:39.767156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:29:39.767156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:29:39.767156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:29:39.767156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:29:39.767156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:29:39.767156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:29:39.767156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:29:39.767156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:29:39.767156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:29:39.767156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:29:39.767156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 could not be found. Jun 16 16:29:39.767156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:29:39.767156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:29:39.767156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:29:39.767156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:29:39.767156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:29:39.767156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:29:39.767156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:29:39.767156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:29:39.767156 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:29:39.770150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:29:39.770150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:29:39.770150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:29:39.770150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:29:39.770150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:29:39.770150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:29:39.770150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:29:39.770150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 could not be found. Jun 16 16:29:39.770150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:29:39.770150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:29:39.770150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:29:39.770150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:29:39.770150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:29:39.770150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:29:39.770150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:29:39.770150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:29:39.770150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 could not be found. Jun 16 16:29:39.770150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:29:39.771568 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-9e02c9d0-96be-428b-8993-78b8eea2f4f0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Returning 404 to user: Instance 04ee4e81-9700-4e68-8206-ef3f08d9f8b7 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:29:39.771568 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-9e02c9d0-96be-428b-8993-78b8eea2f4f0 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7" status: 404 len: 111 microversion: 2.1 time: 0.032028 Jun 16 16:29:39.771568 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 638/1276] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:29:39 2022] GET /compute/v2.1/servers/04ee4e81-9700-4e68-8206-ef3f08d9f8b7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:29:40.908402 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ac5586f4-c8c8-4a2a-ac56-ab8b723b7143 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:40.908904 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ac5586f4-c8c8-4a2a-ac56-ab8b723b7143 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:40.916196 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ac5586f4-c8c8-4a2a-ac56-ab8b723b7143 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:40.916647 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ac5586f4-c8c8-4a2a-ac56-ab8b723b7143 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:40.917418 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ac5586f4-c8c8-4a2a-ac56-ab8b723b7143 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:40.917908 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ac5586f4-c8c8-4a2a-ac56-ab8b723b7143 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:40.932335 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-ac5586f4-c8c8-4a2a-ac56-ab8b723b7143 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] HTTP exception thrown: Instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 could not be found. Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ac5586f4-c8c8-4a2a-ac56-ab8b723b7143 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Request method failure captured: Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: DELETE /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 HTTP/1.1 Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1iYjYC_t6EwK1D26TF8cExWvwcMMl8sM1bZOzgw1iMuPmBOfAYyhFDyEwheYCjuoVAGA_E-hRBQWuPx_miciHdaR2FD4tx0ylJ7iDH3par9-6UIWuJzw-O969-gztmcvty2xvaiq9tZ-UiekiBdjdmcgd_91UvWbb3zCoNFpsUWdsQ Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: 41f6c4a1b7784d7d874b00d5e43507cf Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-AttachVolumeTestJSON-99850122 Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:29:40.933939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:29:40.935595 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/41f6c4a1b7784d7d874b00d5e43507cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/41f6c4a1b7784d7d874b00d5e43507cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_41f6c4a1b7784d7d874b00d5e43507cf", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/41f6c4a1b7784d7d874b00d5e43507cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:29:40.935595 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-AttachVolumeTestJSON-99850122 Jun 16 16:29:40.935595 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 41f6c4a1b7784d7d874b00d5e43507cf Jun 16 16:29:40.935595 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-AttachVolumeTestJSON-99850122 Jun 16 16:29:40.935595 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-AttachVolumeTestJSON-99850122-project Jun 16 16:29:40.935595 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:29:40.935595 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:29:40.935595 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: c6c53bf1554a4825afd8770ea9347ad1 Jun 16 16:29:40.935595 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-AttachVolumeTestJSON-99850122-project Jun 16 16:29:40.935595 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:29:40.935595 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 could not be found. Jun 16 16:29:40.935595 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': '3b0f7646-c731-405a-ac41-0e889b5fdb56'} Jun 16 16:29:40.938717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:29:40.938717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:29:40.938717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:29:40.938717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:29:40.938717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:29:40.938717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:29:40.938717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:29:40.938717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:29:40.938717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:29:40.938717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:29:40.938717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 could not be found. Jun 16 16:29:40.938717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:29:40.938717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:29:40.938717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:29:40.938717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:29:40.938717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:29:40.938717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:29:40.938717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:29:40.938717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:29:40.938717 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:29:40.940466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:29:40.940466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:29:40.940466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:29:40.940466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:29:40.940466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:29:40.940466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:29:40.940466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:29:40.940466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:29:40.940466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:29:40.940466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 could not be found. Jun 16 16:29:40.940466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:29:40.940466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:29:40.940466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:29:40.940466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:29:40.940466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:29:40.940466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:29:40.940466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:29:40.940466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:29:40.940466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 could not be found. Jun 16 16:29:40.940466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:29:40.942381 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ac5586f4-c8c8-4a2a-ac56-ab8b723b7143 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Returning 404 to user: Instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:29:40.942381 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ac5586f4-c8c8-4a2a-ac56-ab8b723b7143 tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 404 len: 111 microversion: 2.1 time: 0.030780 Jun 16 16:29:40.942381 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 639/1277] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:29:40 2022] DELETE /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:29:40.943907 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fe57d94c-36ab-4bd4-894f-6af03219110a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:29:40.944879 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fe57d94c-36ab-4bd4-894f-6af03219110a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] [instance: 3b0f7646-c731-405a-ac41-0e889b5fdb56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:29:40.947977 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:29:40.955931 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fe57d94c-36ab-4bd4-894f-6af03219110a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:40.956466 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fe57d94c-36ab-4bd4-894f-6af03219110a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:40.957247 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fe57d94c-36ab-4bd4-894f-6af03219110a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:29:40.957685 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fe57d94c-36ab-4bd4-894f-6af03219110a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:29:40.961052 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:29:40.974975 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-fe57d94c-36ab-4bd4-894f-6af03219110a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] HTTP exception thrown: Instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 could not be found. Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fe57d94c-36ab-4bd4-894f-6af03219110a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Request method failure captured: Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 HTTP/1.1 Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1iYjYC_t6EwK1D26TF8cExWvwcMMl8sM1bZOzgw1iMuPmBOfAYyhFDyEwheYCjuoVAGA_E-hRBQWuPx_miciHdaR2FD4tx0ylJ7iDH3par9-6UIWuJzw-O969-gztmcvty2xvaiq9tZ-UiekiBdjdmcgd_91UvWbb3zCoNFpsUWdsQ Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: 41f6c4a1b7784d7d874b00d5e43507cf Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-AttachVolumeTestJSON-99850122 Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:29:40.976638 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:29:40.978680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/41f6c4a1b7784d7d874b00d5e43507cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/41f6c4a1b7784d7d874b00d5e43507cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_41f6c4a1b7784d7d874b00d5e43507cf", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/41f6c4a1b7784d7d874b00d5e43507cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:29:40.978680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-AttachVolumeTestJSON-99850122 Jun 16 16:29:40.978680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 41f6c4a1b7784d7d874b00d5e43507cf Jun 16 16:29:40.978680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-AttachVolumeTestJSON-99850122 Jun 16 16:29:40.978680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-AttachVolumeTestJSON-99850122-project Jun 16 16:29:40.978680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:29:40.978680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:29:40.978680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: c6c53bf1554a4825afd8770ea9347ad1 Jun 16 16:29:40.978680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-AttachVolumeTestJSON-99850122-project Jun 16 16:29:40.978680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:29:40.978680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 could not be found. Jun 16 16:29:40.978680 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '3b0f7646-c731-405a-ac41-0e889b5fdb56'} Jun 16 16:29:40.980044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:29:40.980044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:29:40.980044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:29:40.980044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:29:40.980044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:29:40.980044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:29:40.980044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:29:40.980044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:29:40.980044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:29:40.980044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:29:40.980044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 could not be found. Jun 16 16:29:40.980044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:29:40.980044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:29:40.980044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:29:40.980044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:29:40.980044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:29:40.980044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:29:40.980044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:29:40.980044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:29:40.980044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:29:40.982312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:29:40.982312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:29:40.982312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:29:40.982312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:29:40.982312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:29:40.982312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:29:40.982312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:29:40.982312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 could not be found. Jun 16 16:29:40.982312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:29:40.982312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:29:40.982312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:29:40.982312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:29:40.982312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:29:40.982312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:29:40.982312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:29:40.982312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:29:40.982312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 could not be found. Jun 16 16:29:40.982312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:29:40.983981 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fe57d94c-36ab-4bd4-894f-6af03219110a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] Returning 404 to user: Instance 3b0f7646-c731-405a-ac41-0e889b5fdb56 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:29:40.983981 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fe57d94c-36ab-4bd4-894f-6af03219110a tempest-AttachVolumeTestJSON-99850122 tempest-AttachVolumeTestJSON-99850122-project] 10.222.0.88 "GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56" status: 404 len: 111 microversion: 2.1 time: 0.038067 Jun 16 16:29:40.983981 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 639/1278] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:29:40 2022] GET /compute/v2.1/servers/3b0f7646-c731-405a-ac41-0e889b5fdb56 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:31:00.783616 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:31:00.784365 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:31:00.973833 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c2058cc8-4d50-4e59-8900-16fe8f00c569 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Action: 'create', calling method: .version_select at 0x7f6f0d14edc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-373824487", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIQTPKQQ23J5z5qs6eA6TJjOXklgmbA9LLsO7w2M9eZViA5JV58ERrs+6fAN6yVODg0gwlE6ZiaE/S5LOgmF3tfKq1V1V3uarJ169K14Poq4G104jUVDgJUtS1RJRNZ8g=="}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:31:00.988227 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-c2058cc8-4d50-4e59-8900-16fe8f00c569 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Getting quotas for project 3643cc8acf58444383e525f1990d1129. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:31:00.993389 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-c2058cc8-4d50-4e59-8900-16fe8f00c569 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Getting quotas for user 5bd17610e5f44d70a9f3f83abfc1e6c8 and project 3643cc8acf58444383e525f1990d1129. Resources: {'key_pairs'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:31:01.018979 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c2058cc8-4d50-4e59-8900-16fe8f00c569 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.237228 Jun 16 16:31:01.019590 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 640/1279] 10.222.0.88 () {60 vars in 1158 bytes} [Thu Jun 16 16:31:00 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:31:05.418640 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:31:05.418640 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Thu Jun 16 16:31:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:31:27.088091 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:31:27.092232 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e6b3df5d-cd18-4556-8f1f-463e0e65391b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2136255978", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-373824487", "security_groups": [{"name": "tempest-secgroup-smoke-1186202417"}], "block_device_mapping_v2": [{"uuid": "a377b7a6-97f1-46ed-b16f-0e801578efd0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a4761258-d752-4e48-942f-d11f7b716bfd"}]}} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:31:27.204631 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.network.neutron [None req-e6b3df5d-cd18-4556-8f1f-463e0e65391b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] validate_networks() for [('a4761258-d752-4e48-942f-d11f7b716bfd', None, None, None, None, None)] {{(pid=117711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:31:27.666342 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-e6b3df5d-cd18-4556-8f1f-463e0e65391b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Flavor limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:31:27.666770 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-e6b3df5d-cd18-4556-8f1f-463e0e65391b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Image limits 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:31:27.667245 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-e6b3df5d-cd18-4556-8f1f-463e0e65391b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Flavor pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:31:27.667661 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-e6b3df5d-cd18-4556-8f1f-463e0e65391b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Image pref 0:0:0 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:31:27.668073 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.virt.hardware [None req-e6b3df5d-cd18-4556-8f1f-463e0e65391b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:31:27.676946 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e6b3df5d-cd18-4556-8f1f-463e0e65391b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:27.677431 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e6b3df5d-cd18-4556-8f1f-463e0e65391b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:27.678273 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e6b3df5d-cd18-4556-8f1f-463e0e65391b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:27.678712 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e6b3df5d-cd18-4556-8f1f-463e0e65391b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:27.695541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-e6b3df5d-cd18-4556-8f1f-463e0e65391b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Getting quotas for project 3643cc8acf58444383e525f1990d1129. Resources: {'ram', 'instances', 'cores'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:31:27.699474 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.quota [None req-e6b3df5d-cd18-4556-8f1f-463e0e65391b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Getting quotas for user 5bd17610e5f44d70a9f3f83abfc1e6c8 and project 3643cc8acf58444383e525f1990d1129. Resources: {'ram', 'instances', 'cores'} {{(pid=117711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:31:27.756995 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e6b3df5d-cd18-4556-8f1f-463e0e65391b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Going to run 1 instances... {{(pid=117711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:31:27.759132 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e6b3df5d-cd18-4556-8f1f-463e0e65391b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a377b7a6-97f1-46ed-b16f-0e801578efd0',volume_size=None,volume_type=None)] {{(pid=117711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:31:27.885997 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e6b3df5d-cd18-4556-8f1f-463e0e65391b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.799946 Jun 16 16:31:27.886755 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 640/1280] 10.222.0.88 () {60 vars in 1146 bytes} [Thu Jun 16 16:31:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:31:27.894343 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=4 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:31:27.895221 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:31:27.899428 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-db8362e0-0615-4d3a-9613-8a9923f4602c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:31:27.900465 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-db8362e0-0615-4d3a-9613-8a9923f4602c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:31:27.959957 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-db8362e0-0615-4d3a-9613-8a9923f4602c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:31:27.966611 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-db8362e0-0615-4d3a-9613-8a9923f4602c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 200 len: 1094 microversion: 2.1 time: 0.073843 Jun 16 16:31:27.967225 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 641/1281] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:31:27 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:31:28.983856 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1af48dd2-bc35-4ee1-bc2f-091b7e8fe5eb tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:31:28.984576 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1af48dd2-bc35-4ee1-bc2f-091b7e8fe5eb tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:31:28.991387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1af48dd2-bc35-4ee1-bc2f-091b7e8fe5eb tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:28.991830 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1af48dd2-bc35-4ee1-bc2f-091b7e8fe5eb tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:28.992588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1af48dd2-bc35-4ee1-bc2f-091b7e8fe5eb tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:28.993025 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1af48dd2-bc35-4ee1-bc2f-091b7e8fe5eb tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:29.064626 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1af48dd2-bc35-4ee1-bc2f-091b7e8fe5eb tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:31:29.073384 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1af48dd2-bc35-4ee1-bc2f-091b7e8fe5eb tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 200 len: 1200 microversion: 2.1 time: 0.093336 Jun 16 16:31:29.074192 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 641/1282] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:31:28 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 1200 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:31:30.091031 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-93e63956-6921-405a-a0ac-fccf901e2bd3 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:31:30.091584 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-93e63956-6921-405a-a0ac-fccf901e2bd3 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:31:30.098804 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-93e63956-6921-405a-a0ac-fccf901e2bd3 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:30.100071 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-93e63956-6921-405a-a0ac-fccf901e2bd3 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:30.100837 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-93e63956-6921-405a-a0ac-fccf901e2bd3 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:30.101270 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-93e63956-6921-405a-a0ac-fccf901e2bd3 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:30.303237 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-93e63956-6921-405a-a0ac-fccf901e2bd3 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:31:30.311394 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-93e63956-6921-405a-a0ac-fccf901e2bd3 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 200 len: 1266 microversion: 2.1 time: 0.224242 Jun 16 16:31:30.320551 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 642/1283] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:31:30 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:31:30.810969 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-0cd1043f-0712-4842-beea-0de867848357 req-42ab564a-6b38-4bba-b190-a55a7ed52322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6", "tag": "d59314cc-c5e6-49bb-8cf8-8b2fbffc557e"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:31:30.822217 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-0cd1043f-0712-4842-beea-0de867848357 req-42ab564a-6b38-4bba-b190-a55a7ed52322 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:30.822588 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-0cd1043f-0712-4842-beea-0de867848357 req-42ab564a-6b38-4bba-b190-a55a7ed52322 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:30.839956 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-0cd1043f-0712-4842-beea-0de867848357 req-42ab564a-6b38-4bba-b190-a55a7ed52322 service nova] Creating event network-changed:d59314cc-c5e6-49bb-8cf8-8b2fbffc557e for instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 on hv-cinder-83735 Jun 16 16:31:30.844947 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-0cd1043f-0712-4842-beea-0de867848357 req-42ab564a-6b38-4bba-b190-a55a7ed52322 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038212 Jun 16 16:31:30.845547 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 642/1284] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:31:31.328487 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-16dcabdd-bf13-40fd-bf22-27c543dd6361 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:31:31.329320 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-16dcabdd-bf13-40fd-bf22-27c543dd6361 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:31:31.337127 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-16dcabdd-bf13-40fd-bf22-27c543dd6361 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:31.337659 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-16dcabdd-bf13-40fd-bf22-27c543dd6361 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:31.338470 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-16dcabdd-bf13-40fd-bf22-27c543dd6361 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:31.338989 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-16dcabdd-bf13-40fd-bf22-27c543dd6361 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:31.473624 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-16dcabdd-bf13-40fd-bf22-27c543dd6361 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:31:31.481298 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-16dcabdd-bf13-40fd-bf22-27c543dd6361 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 200 len: 1266 microversion: 2.1 time: 0.156771 Jun 16 16:31:31.481920 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 643/1285] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:31:31 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:31:32.499535 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-641a9b49-7c55-464f-8ab5-83226941bfee tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:31:32.500134 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-641a9b49-7c55-464f-8ab5-83226941bfee tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:31:32.507141 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-641a9b49-7c55-464f-8ab5-83226941bfee tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:32.507579 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-641a9b49-7c55-464f-8ab5-83226941bfee tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:32.508332 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-641a9b49-7c55-464f-8ab5-83226941bfee tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:32.508761 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-641a9b49-7c55-464f-8ab5-83226941bfee tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:32.646831 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-641a9b49-7c55-464f-8ab5-83226941bfee tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:31:32.654366 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-641a9b49-7c55-464f-8ab5-83226941bfee tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 200 len: 1266 microversion: 2.1 time: 0.159569 Jun 16 16:31:32.655159 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 643/1286] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:31:32 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:31:33.671212 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-dc3baa65-d720-42e9-82a1-093d768d0622 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:31:33.671843 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dc3baa65-d720-42e9-82a1-093d768d0622 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:31:33.678516 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dc3baa65-d720-42e9-82a1-093d768d0622 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:33.678967 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dc3baa65-d720-42e9-82a1-093d768d0622 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:33.679730 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dc3baa65-d720-42e9-82a1-093d768d0622 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:33.680165 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dc3baa65-d720-42e9-82a1-093d768d0622 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:33.817013 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dc3baa65-d720-42e9-82a1-093d768d0622 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:31:33.825000 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-dc3baa65-d720-42e9-82a1-093d768d0622 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 200 len: 1266 microversion: 2.1 time: 0.157598 Jun 16 16:31:33.825563 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 644/1287] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:31:33 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:31:34.842505 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-57d911f9-3fd0-465d-a9f6-e6b1b6f87fb6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:31:34.843131 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-57d911f9-3fd0-465d-a9f6-e6b1b6f87fb6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:31:34.850870 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-57d911f9-3fd0-465d-a9f6-e6b1b6f87fb6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:34.851324 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-57d911f9-3fd0-465d-a9f6-e6b1b6f87fb6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:34.852088 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-57d911f9-3fd0-465d-a9f6-e6b1b6f87fb6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:34.852528 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-57d911f9-3fd0-465d-a9f6-e6b1b6f87fb6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:34.983041 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-57d911f9-3fd0-465d-a9f6-e6b1b6f87fb6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:31:34.990802 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-57d911f9-3fd0-465d-a9f6-e6b1b6f87fb6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 200 len: 1266 microversion: 2.1 time: 0.152226 Jun 16 16:31:34.991370 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 644/1288] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:31:34 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:31:36.007517 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b906d6f2-26dd-4999-afc2-3f454dfa86c0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:31:36.008112 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-b906d6f2-26dd-4999-afc2-3f454dfa86c0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:31:36.014638 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b906d6f2-26dd-4999-afc2-3f454dfa86c0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:36.015081 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b906d6f2-26dd-4999-afc2-3f454dfa86c0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:36.015839 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b906d6f2-26dd-4999-afc2-3f454dfa86c0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:36.016277 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-b906d6f2-26dd-4999-afc2-3f454dfa86c0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:36.149955 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-b906d6f2-26dd-4999-afc2-3f454dfa86c0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:31:36.157562 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b906d6f2-26dd-4999-afc2-3f454dfa86c0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 200 len: 1266 microversion: 2.1 time: 0.153982 Jun 16 16:31:36.158236 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 645/1289] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:31:36 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:31:37.175031 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-eb6f36c1-2600-4480-969e-a68832c8b26b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:31:37.175891 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-eb6f36c1-2600-4480-969e-a68832c8b26b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:31:37.183368 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb6f36c1-2600-4480-969e-a68832c8b26b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:37.184063 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb6f36c1-2600-4480-969e-a68832c8b26b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:37.184819 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb6f36c1-2600-4480-969e-a68832c8b26b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:37.185551 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-eb6f36c1-2600-4480-969e-a68832c8b26b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:37.316624 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-eb6f36c1-2600-4480-969e-a68832c8b26b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:31:37.324679 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-eb6f36c1-2600-4480-969e-a68832c8b26b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 200 len: 1266 microversion: 2.1 time: 0.153508 Jun 16 16:31:37.325243 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 645/1290] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:31:37 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:31:38.342827 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-3198f40f-4506-4953-8cbf-9890785e1c6e tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:31:38.343486 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-3198f40f-4506-4953-8cbf-9890785e1c6e tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:31:38.346044 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:31:38.352689 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3198f40f-4506-4953-8cbf-9890785e1c6e tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:38.353193 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3198f40f-4506-4953-8cbf-9890785e1c6e tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:38.354005 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3198f40f-4506-4953-8cbf-9890785e1c6e tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:38.354444 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-3198f40f-4506-4953-8cbf-9890785e1c6e tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:38.498343 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-3198f40f-4506-4953-8cbf-9890785e1c6e tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:31:38.506325 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-3198f40f-4506-4953-8cbf-9890785e1c6e tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 200 len: 1266 microversion: 2.1 time: 0.167691 Jun 16 16:31:38.506907 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 646/1291] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:31:38 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:31:39.524312 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-38a7a0f5-b0a1-49e5-9bb2-291d5bf65ed6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:31:39.524927 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-38a7a0f5-b0a1-49e5-9bb2-291d5bf65ed6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:31:39.526839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:31:39.527633 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=6 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:31:39.534706 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-38a7a0f5-b0a1-49e5-9bb2-291d5bf65ed6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:39.535308 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-38a7a0f5-b0a1-49e5-9bb2-291d5bf65ed6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:39.536317 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-38a7a0f5-b0a1-49e5-9bb2-291d5bf65ed6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:39.536887 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-38a7a0f5-b0a1-49e5-9bb2-291d5bf65ed6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:39.674066 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-38a7a0f5-b0a1-49e5-9bb2-291d5bf65ed6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:31:39.681698 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-38a7a0f5-b0a1-49e5-9bb2-291d5bf65ed6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 200 len: 1266 microversion: 2.1 time: 0.161906 Jun 16 16:31:39.682298 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 646/1292] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:31:39 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:31:40.698693 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-462d6407-5518-4572-9ea2-861b7bb94075 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:31:40.699303 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-462d6407-5518-4572-9ea2-861b7bb94075 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:31:40.706077 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-462d6407-5518-4572-9ea2-861b7bb94075 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:40.706526 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-462d6407-5518-4572-9ea2-861b7bb94075 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:40.707315 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-462d6407-5518-4572-9ea2-861b7bb94075 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:40.707755 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-462d6407-5518-4572-9ea2-861b7bb94075 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:40.850803 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-462d6407-5518-4572-9ea2-861b7bb94075 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:31:40.861768 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-462d6407-5518-4572-9ea2-861b7bb94075 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 200 len: 1266 microversion: 2.1 time: 0.166421 Jun 16 16:31:40.862403 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 647/1293] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:31:40 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:31:41.712805 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-e1b99a57-2499-42c5-98b2-5b16d959c847 req-50c8e558-a008-4b6e-a941-4c453a6de48d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6", "name": "network-vif-plugged", "status": "completed", "tag": "d59314cc-c5e6-49bb-8cf8-8b2fbffc557e"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:31:41.721295 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-e1b99a57-2499-42c5-98b2-5b16d959c847 req-50c8e558-a008-4b6e-a941-4c453a6de48d service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:41.721757 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-e1b99a57-2499-42c5-98b2-5b16d959c847 req-50c8e558-a008-4b6e-a941-4c453a6de48d service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:41.733563 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-e1b99a57-2499-42c5-98b2-5b16d959c847 req-50c8e558-a008-4b6e-a941-4c453a6de48d service nova] Creating event network-vif-plugged:d59314cc-c5e6-49bb-8cf8-8b2fbffc557e for instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 on hv-cinder-83735 Jun 16 16:31:41.738925 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-e1b99a57-2499-42c5-98b2-5b16d959c847 req-50c8e558-a008-4b6e-a941-4c453a6de48d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094731 Jun 16 16:31:41.740037 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 647/1294] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:31:41.880897 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d6428f30-c5fd-4f0e-a4b9-d58f10afba18 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:31:41.881626 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d6428f30-c5fd-4f0e-a4b9-d58f10afba18 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:31:41.888588 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d6428f30-c5fd-4f0e-a4b9-d58f10afba18 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:41.889124 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d6428f30-c5fd-4f0e-a4b9-d58f10afba18 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:41.890068 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d6428f30-c5fd-4f0e-a4b9-d58f10afba18 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:41.890527 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d6428f30-c5fd-4f0e-a4b9-d58f10afba18 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:42.076753 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d6428f30-c5fd-4f0e-a4b9-d58f10afba18 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:31:42.085083 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d6428f30-c5fd-4f0e-a4b9-d58f10afba18 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 200 len: 1266 microversion: 2.1 time: 0.208543 Jun 16 16:31:42.085689 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 648/1295] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:31:41 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:31:43.103656 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-e5f7f282-3044-4b02-93b6-2a5b97ce9b7d tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:31:43.104343 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-e5f7f282-3044-4b02-93b6-2a5b97ce9b7d tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:31:43.110728 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e5f7f282-3044-4b02-93b6-2a5b97ce9b7d tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:43.111163 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e5f7f282-3044-4b02-93b6-2a5b97ce9b7d tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:43.111918 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e5f7f282-3044-4b02-93b6-2a5b97ce9b7d tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:43.112345 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-e5f7f282-3044-4b02-93b6-2a5b97ce9b7d tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:43.252442 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-e5f7f282-3044-4b02-93b6-2a5b97ce9b7d tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:31:43.260469 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-e5f7f282-3044-4b02-93b6-2a5b97ce9b7d tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 200 len: 1266 microversion: 2.1 time: 0.162147 Jun 16 16:31:43.261034 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 648/1296] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:31:43 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:31:44.277193 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-ab45f9ed-7eb5-4d59-a49e-1b7690bea604 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:31:44.277856 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-ab45f9ed-7eb5-4d59-a49e-1b7690bea604 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:31:44.284837 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ab45f9ed-7eb5-4d59-a49e-1b7690bea604 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:44.285424 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ab45f9ed-7eb5-4d59-a49e-1b7690bea604 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:44.286114 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ab45f9ed-7eb5-4d59-a49e-1b7690bea604 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:44.287049 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-ab45f9ed-7eb5-4d59-a49e-1b7690bea604 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:44.422281 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-ab45f9ed-7eb5-4d59-a49e-1b7690bea604 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:31:44.429766 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-ab45f9ed-7eb5-4d59-a49e-1b7690bea604 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 200 len: 1454 microversion: 2.1 time: 0.156459 Jun 16 16:31:44.430338 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 649/1297] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:31:44 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:31:44.446423 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-b0b9b57a-808b-464b-a298-833786ec7303 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:31:44.447028 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-b0b9b57a-808b-464b-a298-833786ec7303 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:31:44.453513 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b0b9b57a-808b-464b-a298-833786ec7303 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:44.453950 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b0b9b57a-808b-464b-a298-833786ec7303 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:44.454707 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b0b9b57a-808b-464b-a298-833786ec7303 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:44.455135 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-b0b9b57a-808b-464b-a298-833786ec7303 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:44.593828 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-b0b9b57a-808b-464b-a298-833786ec7303 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:31:44.602222 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-b0b9b57a-808b-464b-a298-833786ec7303 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 200 len: 1454 microversion: 2.1 time: 0.160207 Jun 16 16:31:44.602791 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 649/1298] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:31:44 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:31:46.374835 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-838776d0-07b2-4043-8792-566faa333d91 req-3181dbf1-5458-48f6-8768-ed289ef268ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6", "tag": "d59314cc-c5e6-49bb-8cf8-8b2fbffc557e"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:31:46.383011 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-838776d0-07b2-4043-8792-566faa333d91 req-3181dbf1-5458-48f6-8768-ed289ef268ab service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:46.383466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-838776d0-07b2-4043-8792-566faa333d91 req-3181dbf1-5458-48f6-8768-ed289ef268ab service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:46.395005 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-838776d0-07b2-4043-8792-566faa333d91 req-3181dbf1-5458-48f6-8768-ed289ef268ab service nova] Creating event network-changed:d59314cc-c5e6-49bb-8cf8-8b2fbffc557e for instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 on hv-cinder-83735 Jun 16 16:31:46.401041 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-838776d0-07b2-4043-8792-566faa333d91 req-3181dbf1-5458-48f6-8768-ed289ef268ab service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092075 Jun 16 16:31:46.402021 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 650/1299] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:32:38.986795 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:32:38.987460 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Thu Jun 16 16:32:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:32:44.080821 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:32:44.081456 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Thu Jun 16 16:32:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:34:13.150893 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1f7dcc86-22c7-484e-acd6-4da17fd2464e] AMQP server on 10.222.0.88:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 16 16:34:13.151811 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:34:13.152912 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=49 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:34:13.160793 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-de06d133-957a-431e-9cbe-ca9211b9efbe tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:13.160793 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-de06d133-957a-431e-9cbe-ca9211b9efbe tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:13.166964 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-de06d133-957a-431e-9cbe-ca9211b9efbe tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:13.167534 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-de06d133-957a-431e-9cbe-ca9211b9efbe tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:13.168433 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-de06d133-957a-431e-9cbe-ca9211b9efbe tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:13.169072 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-de06d133-957a-431e-9cbe-ca9211b9efbe tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:13.198927 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-de06d133-957a-431e-9cbe-ca9211b9efbe tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:34:13.269999 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR oslo.messaging._drivers.impl_rabbit [None req-de06d133-957a-431e-9cbe-ca9211b9efbe tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [fe6a3d7b-22ce-494e-a9a5-65675496d993] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 16:34:14.160603 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] [1f7dcc86-22c7-484e-acd6-4da17fd2464e] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 37494. Jun 16 16:34:14.277528 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [None req-de06d133-957a-431e-9cbe-ca9211b9efbe tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [fe6a3d7b-22ce-494e-a9a5-65675496d993] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 37496. Jun 16 16:34:14.306693 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-de06d133-957a-431e-9cbe-ca9211b9efbe tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "DELETE /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 204 len: 0 microversion: 2.1 time: 1.157981 Jun 16 16:34:14.307517 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 650/1300] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:34:13 2022] DELETE /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 0 bytes in 1160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:34:14.314801 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a5c353dc-2be1-44eb-83ae-2d96d8d47750] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 16:34:14.315563 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=22 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:34:14.316328 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=50 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:34:14.321628 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-38990166-43c1-482f-8825-58cab8b1e64c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:14.322387 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-38990166-43c1-482f-8825-58cab8b1e64c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:14.329940 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-38990166-43c1-482f-8825-58cab8b1e64c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:14.330395 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-38990166-43c1-482f-8825-58cab8b1e64c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:14.331181 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-38990166-43c1-482f-8825-58cab8b1e64c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:14.331624 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-38990166-43c1-482f-8825-58cab8b1e64c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:14.531473 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-38990166-43c1-482f-8825-58cab8b1e64c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:14.540180 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-38990166-43c1-482f-8825-58cab8b1e64c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 200 len: 1579 microversion: 2.1 time: 0.227145 Jun 16 16:34:14.540995 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 651/1301] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:14 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 1579 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:34:15.560479 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f2e67822-1a99-4834-a734-f81127ce400f tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:15.561169 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f2e67822-1a99-4834-a734-f81127ce400f tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:15.571180 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f2e67822-1a99-4834-a734-f81127ce400f tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:15.571627 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f2e67822-1a99-4834-a734-f81127ce400f tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:15.572407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f2e67822-1a99-4834-a734-f81127ce400f tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:15.572839 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f2e67822-1a99-4834-a734-f81127ce400f tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:15.774851 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f2e67822-1a99-4834-a734-f81127ce400f tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:15.782408 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f2e67822-1a99-4834-a734-f81127ce400f tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 200 len: 1579 microversion: 2.1 time: 0.226496 Jun 16 16:34:15.783513 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 651/1302] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:15 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 1579 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:34:16.800076 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-309bbd8c-8031-4605-9c61-8b9194e98ce4 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:16.800784 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-309bbd8c-8031-4605-9c61-8b9194e98ce4 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:16.809617 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-309bbd8c-8031-4605-9c61-8b9194e98ce4 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:16.810091 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-309bbd8c-8031-4605-9c61-8b9194e98ce4 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:16.810910 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-309bbd8c-8031-4605-9c61-8b9194e98ce4 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:16.811319 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-309bbd8c-8031-4605-9c61-8b9194e98ce4 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:16.817935 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO oslo.messaging._drivers.impl_rabbit [-] [a5c353dc-2be1-44eb-83ae-2d96d8d47750] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 37510. Jun 16 16:34:16.902654 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-309bbd8c-8031-4605-9c61-8b9194e98ce4 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:16.910273 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-309bbd8c-8031-4605-9c61-8b9194e98ce4 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 200 len: 1511 microversion: 2.1 time: 0.114580 Jun 16 16:34:16.910875 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 652/1303] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:16 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 1511 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:34:17.104674 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-63e3adf1-d694-4f27-a812-fc919257ac76 req-5ae478f0-4c70-456e-b637-db9d00f1ab4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6", "name": "network-vif-deleted", "tag": "d59314cc-c5e6-49bb-8cf8-8b2fbffc557e"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:34:17.113818 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-63e3adf1-d694-4f27-a812-fc919257ac76 req-5ae478f0-4c70-456e-b637-db9d00f1ab4b service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:17.114324 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-63e3adf1-d694-4f27-a812-fc919257ac76 req-5ae478f0-4c70-456e-b637-db9d00f1ab4b service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:17.127180 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-63e3adf1-d694-4f27-a812-fc919257ac76 req-5ae478f0-4c70-456e-b637-db9d00f1ab4b service nova] Creating event network-vif-deleted:d59314cc-c5e6-49bb-8cf8-8b2fbffc557e for instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 on hv-cinder-83735 Jun 16 16:34:17.132687 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-63e3adf1-d694-4f27-a812-fc919257ac76 req-5ae478f0-4c70-456e-b637-db9d00f1ab4b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031843 Jun 16 16:34:17.133941 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 652/1304] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:34:17.928352 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-998ca3c1-ea85-47dc-a54d-3a6e7cbfa737 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:17.929068 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-998ca3c1-ea85-47dc-a54d-3a6e7cbfa737 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:17.936765 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-998ca3c1-ea85-47dc-a54d-3a6e7cbfa737 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:17.937185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-998ca3c1-ea85-47dc-a54d-3a6e7cbfa737 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:17.938254 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-998ca3c1-ea85-47dc-a54d-3a6e7cbfa737 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:17.938690 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-998ca3c1-ea85-47dc-a54d-3a6e7cbfa737 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:17.977111 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-998ca3c1-ea85-47dc-a54d-3a6e7cbfa737 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:17.977641 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-998ca3c1-ea85-47dc-a54d-3a6e7cbfa737 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:17.978328 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-998ca3c1-ea85-47dc-a54d-3a6e7cbfa737 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lazy-loading 'fault' on Instance uuid abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:34:18.034492 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-998ca3c1-ea85-47dc-a54d-3a6e7cbfa737 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:18.042904 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-998ca3c1-ea85-47dc-a54d-3a6e7cbfa737 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 200 len: 1230 microversion: 2.1 time: 0.118716 Jun 16 16:34:18.043784 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 653/1305] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:17 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 1230 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:34:19.061421 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0c05169a-00e5-4b35-885c-a7eb0c00f2fe tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:19.062176 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0c05169a-00e5-4b35-885c-a7eb0c00f2fe tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:19.068538 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0c05169a-00e5-4b35-885c-a7eb0c00f2fe tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:19.068982 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0c05169a-00e5-4b35-885c-a7eb0c00f2fe tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:19.069771 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0c05169a-00e5-4b35-885c-a7eb0c00f2fe tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:19.070211 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-0c05169a-00e5-4b35-885c-a7eb0c00f2fe tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:19.084852 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-0c05169a-00e5-4b35-885c-a7eb0c00f2fe tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] HTTP exception thrown: Instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 could not be found. Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0c05169a-00e5-4b35-885c-a7eb0c00f2fe tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Request method failure captured: Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 HTTP/1.1 Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1q_aifSKNCXFcIBoY1svH5p5tFOMXXGrBhu5TnvYcse2ePDt2C48cKqPuZCPm7QvAo_CswYv7WmWWNAt1ROn72RYtn25HI4uyt6rBSkWYQ8FMwzzBsbzxm7M05_AZIKGacyLtNvVQgRDLHGK6terK2m_VHyrF3lgMumUHn2MIv85QQ Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: 3643cc8acf58444383e525f1990d1129 Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-TestVolumeBootPattern-419486644 Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:34:19.086537 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:34:19.088407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3643cc8acf58444383e525f1990d1129"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3643cc8acf58444383e525f1990d1129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3643cc8acf58444383e525f1990d1129", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3643cc8acf58444383e525f1990d1129"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:34:19.088407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-TestVolumeBootPattern-419486644 Jun 16 16:34:19.088407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 3643cc8acf58444383e525f1990d1129 Jun 16 16:34:19.088407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-TestVolumeBootPattern-419486644 Jun 16 16:34:19.088407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-TestVolumeBootPattern-419486644-project Jun 16 16:34:19.088407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:34:19.088407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:34:19.088407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: 5bd17610e5f44d70a9f3f83abfc1e6c8 Jun 16 16:34:19.088407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-TestVolumeBootPattern-419486644-project Jun 16 16:34:19.088407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:34:19.088407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 could not be found. Jun 16 16:34:19.088407 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': 'abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6'} Jun 16 16:34:19.089541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:34:19.089541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:19.089541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:34:19.089541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:34:19.089541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:34:19.089541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:34:19.089541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:34:19.089541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:34:19.089541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:34:19.089541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:34:19.089541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 could not be found. Jun 16 16:34:19.089541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:34:19.089541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:34:19.089541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:34:19.089541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:19.089541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:34:19.089541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:34:19.089541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:34:19.089541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:34:19.089541 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:34:19.091426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:34:19.091426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:34:19.091426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:34:19.091426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:34:19.091426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:34:19.091426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:34:19.091426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:34:19.091426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 could not be found. Jun 16 16:34:19.091426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:34:19.091426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:34:19.091426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:34:19.091426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:19.091426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:34:19.091426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:34:19.091426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:34:19.091426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:34:19.091426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 could not be found. Jun 16 16:34:19.091426 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:34:19.093145 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0c05169a-00e5-4b35-885c-a7eb0c00f2fe tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Returning 404 to user: Instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:34:19.093145 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0c05169a-00e5-4b35-885c-a7eb0c00f2fe tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 404 len: 111 microversion: 2.1 time: 0.031255 Jun 16 16:34:19.093145 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 653/1306] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:19 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:34:19.137062 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-17ea7ec1-1090-46fb-b0b8-42546afe4757 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-474630830", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-373824487", "security_groups": [{"name": "tempest-secgroup-smoke-1186202417"}], "block_device_mapping_v2": [{"uuid": "a377b7a6-97f1-46ed-b16f-0e801578efd0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a4761258-d752-4e48-942f-d11f7b716bfd"}]}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:34:19.259537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-17ea7ec1-1090-46fb-b0b8-42546afe4757 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] validate_networks() for [('a4761258-d752-4e48-942f-d11f7b716bfd', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:34:19.702177 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-17ea7ec1-1090-46fb-b0b8-42546afe4757 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:34:19.702612 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-17ea7ec1-1090-46fb-b0b8-42546afe4757 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:34:19.703088 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-17ea7ec1-1090-46fb-b0b8-42546afe4757 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:34:19.703501 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-17ea7ec1-1090-46fb-b0b8-42546afe4757 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:34:19.703913 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-17ea7ec1-1090-46fb-b0b8-42546afe4757 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:34:19.713051 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-17ea7ec1-1090-46fb-b0b8-42546afe4757 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:19.713503 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-17ea7ec1-1090-46fb-b0b8-42546afe4757 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:19.714354 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-17ea7ec1-1090-46fb-b0b8-42546afe4757 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:19.714796 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-17ea7ec1-1090-46fb-b0b8-42546afe4757 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:19.731939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-17ea7ec1-1090-46fb-b0b8-42546afe4757 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Getting quotas for project 3643cc8acf58444383e525f1990d1129. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:34:19.736508 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-17ea7ec1-1090-46fb-b0b8-42546afe4757 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Getting quotas for user 5bd17610e5f44d70a9f3f83abfc1e6c8 and project 3643cc8acf58444383e525f1990d1129. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:34:19.796921 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-17ea7ec1-1090-46fb-b0b8-42546afe4757 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:34:19.799570 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-17ea7ec1-1090-46fb-b0b8-42546afe4757 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a377b7a6-97f1-46ed-b16f-0e801578efd0',volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:34:19.931667 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-17ea7ec1-1090-46fb-b0b8-42546afe4757 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.799414 Jun 16 16:34:19.932319 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 654/1307] 10.222.0.88 () {60 vars in 1146 bytes} [Thu Jun 16 16:34:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:34:19.946467 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-3584d6e6-ae1f-4bd3-8538-285188aa8aa7 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:19.947174 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-3584d6e6-ae1f-4bd3-8538-285188aa8aa7 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:20.002807 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-3584d6e6-ae1f-4bd3-8538-285188aa8aa7 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:20.009577 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-3584d6e6-ae1f-4bd3-8538-285188aa8aa7 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 200 len: 1093 microversion: 2.1 time: 0.071061 Jun 16 16:34:20.010331 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 654/1308] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:19 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:34:21.028527 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-dff85ae3-6e1e-48f2-8c96-63a8dc63002b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:21.029422 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-dff85ae3-6e1e-48f2-8c96-63a8dc63002b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:21.039231 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dff85ae3-6e1e-48f2-8c96-63a8dc63002b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:21.039692 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dff85ae3-6e1e-48f2-8c96-63a8dc63002b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:21.040476 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dff85ae3-6e1e-48f2-8c96-63a8dc63002b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:21.040913 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-dff85ae3-6e1e-48f2-8c96-63a8dc63002b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:21.106067 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-dff85ae3-6e1e-48f2-8c96-63a8dc63002b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:21.114269 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-dff85ae3-6e1e-48f2-8c96-63a8dc63002b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 200 len: 1209 microversion: 2.1 time: 0.090871 Jun 16 16:34:21.114851 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 655/1309] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:21 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 1209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:34:22.132278 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-18b2b28e-4d46-4283-8ee8-70c75f0d3103 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:22.133836 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-18b2b28e-4d46-4283-8ee8-70c75f0d3103 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:22.149247 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-18b2b28e-4d46-4283-8ee8-70c75f0d3103 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:22.149824 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-18b2b28e-4d46-4283-8ee8-70c75f0d3103 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:22.150707 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-18b2b28e-4d46-4283-8ee8-70c75f0d3103 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:22.151150 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-18b2b28e-4d46-4283-8ee8-70c75f0d3103 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:22.381073 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-18b2b28e-4d46-4283-8ee8-70c75f0d3103 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:22.388950 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-18b2b28e-4d46-4283-8ee8-70c75f0d3103 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 200 len: 1265 microversion: 2.1 time: 0.260988 Jun 16 16:34:22.389529 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 655/1310] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:22 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:34:22.765516 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-634a31d1-8ab1-4e6e-ae02-f38ded5775ce req-defa4e40-082e-4a4d-9013-64181da31bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb562ba-8a15-4a83-87a8-cbc71a8ef147", "tag": "9c7b4fe8-06bc-40d3-afd2-f792aab2bc85"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:34:22.799899 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-634a31d1-8ab1-4e6e-ae02-f38ded5775ce req-defa4e40-082e-4a4d-9013-64181da31bc2 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:22.800434 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-634a31d1-8ab1-4e6e-ae02-f38ded5775ce req-defa4e40-082e-4a4d-9013-64181da31bc2 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:22.813655 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-634a31d1-8ab1-4e6e-ae02-f38ded5775ce req-defa4e40-082e-4a4d-9013-64181da31bc2 service nova] Creating event network-changed:9c7b4fe8-06bc-40d3-afd2-f792aab2bc85 for instance 6bb562ba-8a15-4a83-87a8-cbc71a8ef147 on hv-cinder-83735 Jun 16 16:34:22.817338 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR oslo.messaging._drivers.impl_rabbit [req-634a31d1-8ab1-4e6e-ae02-f38ded5775ce req-defa4e40-082e-4a4d-9013-64181da31bc2 service nova] [7707d728-ad41-4bc8-83b5-5867ac950df2] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 16:34:23.406479 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7b566b56-fe1f-405e-9dc8-5ca33a2849ea tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:23.407051 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7b566b56-fe1f-405e-9dc8-5ca33a2849ea tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:23.414522 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7b566b56-fe1f-405e-9dc8-5ca33a2849ea tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:23.414967 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7b566b56-fe1f-405e-9dc8-5ca33a2849ea tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:23.415730 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7b566b56-fe1f-405e-9dc8-5ca33a2849ea tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:23.416160 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7b566b56-fe1f-405e-9dc8-5ca33a2849ea tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:23.557042 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-7b566b56-fe1f-405e-9dc8-5ca33a2849ea tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:23.565914 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7b566b56-fe1f-405e-9dc8-5ca33a2849ea tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 200 len: 1265 microversion: 2.1 time: 0.163284 Jun 16 16:34:23.566986 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 656/1311] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:23 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:34:23.824050 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO oslo.messaging._drivers.impl_rabbit [req-634a31d1-8ab1-4e6e-ae02-f38ded5775ce req-defa4e40-082e-4a4d-9013-64181da31bc2 service nova] [7707d728-ad41-4bc8-83b5-5867ac950df2] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 37556. Jun 16 16:34:23.828581 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-634a31d1-8ab1-4e6e-ae02-f38ded5775ce req-defa4e40-082e-4a4d-9013-64181da31bc2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.067493 Jun 16 16:34:23.829196 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 656/1312] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:34:24.583226 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-6d5bf601-3d65-4052-898b-38c52670a51c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:24.583829 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-6d5bf601-3d65-4052-898b-38c52670a51c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:24.590520 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6d5bf601-3d65-4052-898b-38c52670a51c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:24.590961 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6d5bf601-3d65-4052-898b-38c52670a51c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:24.591721 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6d5bf601-3d65-4052-898b-38c52670a51c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:24.592152 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-6d5bf601-3d65-4052-898b-38c52670a51c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:24.820372 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-6d5bf601-3d65-4052-898b-38c52670a51c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:24.828187 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-6d5bf601-3d65-4052-898b-38c52670a51c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 200 len: 1265 microversion: 2.1 time: 0.248807 Jun 16 16:34:24.828808 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 657/1313] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:24 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:34:25.428671 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:34:25.428900 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Thu Jun 16 16:34:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:34:25.845638 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-10d9dfc3-baee-4118-80f2-9a6ff8f0b1da tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:25.857001 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-10d9dfc3-baee-4118-80f2-9a6ff8f0b1da tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:25.858810 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-10d9dfc3-baee-4118-80f2-9a6ff8f0b1da tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:25.859265 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-10d9dfc3-baee-4118-80f2-9a6ff8f0b1da tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:25.860053 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-10d9dfc3-baee-4118-80f2-9a6ff8f0b1da tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:25.860495 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-10d9dfc3-baee-4118-80f2-9a6ff8f0b1da tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:26.001537 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-10d9dfc3-baee-4118-80f2-9a6ff8f0b1da tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:26.009305 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-10d9dfc3-baee-4118-80f2-9a6ff8f0b1da tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 200 len: 1265 microversion: 2.1 time: 0.168520 Jun 16 16:34:26.009935 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 657/1314] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:25 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:34:27.025915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-fe4bcd57-fa4d-4a40-8c3e-1bc3489de4fc tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:27.026593 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-fe4bcd57-fa4d-4a40-8c3e-1bc3489de4fc tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:27.033849 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fe4bcd57-fa4d-4a40-8c3e-1bc3489de4fc tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:27.034300 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fe4bcd57-fa4d-4a40-8c3e-1bc3489de4fc tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:27.035085 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fe4bcd57-fa4d-4a40-8c3e-1bc3489de4fc tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:27.035495 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-fe4bcd57-fa4d-4a40-8c3e-1bc3489de4fc tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:27.178795 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-fe4bcd57-fa4d-4a40-8c3e-1bc3489de4fc tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:27.186410 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-fe4bcd57-fa4d-4a40-8c3e-1bc3489de4fc tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 200 len: 1265 microversion: 2.1 time: 0.164420 Jun 16 16:34:27.186977 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 658/1315] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:27 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:34:28.203965 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-08afeae5-6029-4f8a-bd5c-a4d9e5a189a4 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:28.204582 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-08afeae5-6029-4f8a-bd5c-a4d9e5a189a4 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:28.211556 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08afeae5-6029-4f8a-bd5c-a4d9e5a189a4 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:28.212008 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08afeae5-6029-4f8a-bd5c-a4d9e5a189a4 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:28.212797 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08afeae5-6029-4f8a-bd5c-a4d9e5a189a4 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:28.213224 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-08afeae5-6029-4f8a-bd5c-a4d9e5a189a4 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:28.347418 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-08afeae5-6029-4f8a-bd5c-a4d9e5a189a4 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:28.355187 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-08afeae5-6029-4f8a-bd5c-a4d9e5a189a4 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 200 len: 1265 microversion: 2.1 time: 0.155078 Jun 16 16:34:28.355750 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 658/1316] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:28 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:34:29.372711 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-36e66bd3-9042-43be-a8d4-6ac434ffbc83 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:29.373354 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-36e66bd3-9042-43be-a8d4-6ac434ffbc83 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:29.379823 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-36e66bd3-9042-43be-a8d4-6ac434ffbc83 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:29.380269 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-36e66bd3-9042-43be-a8d4-6ac434ffbc83 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:29.381032 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-36e66bd3-9042-43be-a8d4-6ac434ffbc83 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:29.381456 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-36e66bd3-9042-43be-a8d4-6ac434ffbc83 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:29.525045 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-36e66bd3-9042-43be-a8d4-6ac434ffbc83 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:29.533157 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-36e66bd3-9042-43be-a8d4-6ac434ffbc83 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 200 len: 1265 microversion: 2.1 time: 0.164328 Jun 16 16:34:29.534344 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 659/1317] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:29 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:34:30.551538 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-6417cffb-1435-420e-bdb2-1fc4724c581b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:30.552158 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-6417cffb-1435-420e-bdb2-1fc4724c581b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:30.554613 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:34:30.555273 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=6 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:34:30.561555 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6417cffb-1435-420e-bdb2-1fc4724c581b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:30.562032 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6417cffb-1435-420e-bdb2-1fc4724c581b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:30.562811 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6417cffb-1435-420e-bdb2-1fc4724c581b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:30.563256 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-6417cffb-1435-420e-bdb2-1fc4724c581b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:30.702644 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-6417cffb-1435-420e-bdb2-1fc4724c581b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:30.710146 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-6417cffb-1435-420e-bdb2-1fc4724c581b tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 200 len: 1265 microversion: 2.1 time: 0.163193 Jun 16 16:34:30.710701 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 659/1318] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:30 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:34:31.727786 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-dd9be6e1-6b66-4566-9796-b4583d150a71 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:31.728387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-dd9be6e1-6b66-4566-9796-b4583d150a71 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:31.730268 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:34:31.736075 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dd9be6e1-6b66-4566-9796-b4583d150a71 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:31.736521 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dd9be6e1-6b66-4566-9796-b4583d150a71 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:31.737282 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dd9be6e1-6b66-4566-9796-b4583d150a71 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:31.737737 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-dd9be6e1-6b66-4566-9796-b4583d150a71 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:31.875017 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-dd9be6e1-6b66-4566-9796-b4583d150a71 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:31.882809 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-dd9be6e1-6b66-4566-9796-b4583d150a71 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 200 len: 1265 microversion: 2.1 time: 0.159097 Jun 16 16:34:31.883387 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 660/1319] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:31 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:34:32.899908 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c9c58753-8843-4919-beee-cf600c572bb7 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:32.901826 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c9c58753-8843-4919-beee-cf600c572bb7 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:32.909618 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c9c58753-8843-4919-beee-cf600c572bb7 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:32.910416 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c9c58753-8843-4919-beee-cf600c572bb7 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:32.911576 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c9c58753-8843-4919-beee-cf600c572bb7 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:32.912218 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c9c58753-8843-4919-beee-cf600c572bb7 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:33.061384 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c9c58753-8843-4919-beee-cf600c572bb7 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:33.070509 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c9c58753-8843-4919-beee-cf600c572bb7 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 200 len: 1265 microversion: 2.1 time: 0.174582 Jun 16 16:34:33.071117 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 660/1320] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:32 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:34:34.087565 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-28721f26-697f-4347-bfb8-a2e4bda93de5 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:34.088162 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-28721f26-697f-4347-bfb8-a2e4bda93de5 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:34.094924 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-28721f26-697f-4347-bfb8-a2e4bda93de5 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:34.095385 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-28721f26-697f-4347-bfb8-a2e4bda93de5 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:34.096694 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-28721f26-697f-4347-bfb8-a2e4bda93de5 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:34.097131 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-28721f26-697f-4347-bfb8-a2e4bda93de5 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:34.230612 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-28721f26-697f-4347-bfb8-a2e4bda93de5 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:34.238469 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-28721f26-697f-4347-bfb8-a2e4bda93de5 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 200 len: 1265 microversion: 2.1 time: 0.154593 Jun 16 16:34:34.239047 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 661/1321] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:34 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:34:34.446279 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-74b80d2a-318c-462b-a9e0-1c19b1890feb req-c3cf75f9-cda6-4e82-9549-dd4b7844b6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb562ba-8a15-4a83-87a8-cbc71a8ef147", "name": "network-vif-plugged", "status": "completed", "tag": "9c7b4fe8-06bc-40d3-afd2-f792aab2bc85"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:34:34.455974 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-74b80d2a-318c-462b-a9e0-1c19b1890feb req-c3cf75f9-cda6-4e82-9549-dd4b7844b6a4 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:34.456477 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-74b80d2a-318c-462b-a9e0-1c19b1890feb req-c3cf75f9-cda6-4e82-9549-dd4b7844b6a4 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:34.468379 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-74b80d2a-318c-462b-a9e0-1c19b1890feb req-c3cf75f9-cda6-4e82-9549-dd4b7844b6a4 service nova] Creating event network-vif-plugged:9c7b4fe8-06bc-40d3-afd2-f792aab2bc85 for instance 6bb562ba-8a15-4a83-87a8-cbc71a8ef147 on hv-cinder-83735 Jun 16 16:34:34.473511 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-74b80d2a-318c-462b-a9e0-1c19b1890feb req-c3cf75f9-cda6-4e82-9549-dd4b7844b6a4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030890 Jun 16 16:34:34.474146 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 661/1322] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:34:35.255811 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-2e008cca-ced1-48ec-aac8-d2ff1c96acf6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:35.256402 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-2e008cca-ced1-48ec-aac8-d2ff1c96acf6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:35.263428 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2e008cca-ced1-48ec-aac8-d2ff1c96acf6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:35.263879 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2e008cca-ced1-48ec-aac8-d2ff1c96acf6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:35.264650 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2e008cca-ced1-48ec-aac8-d2ff1c96acf6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:35.265086 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-2e008cca-ced1-48ec-aac8-d2ff1c96acf6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:35.399046 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-2e008cca-ced1-48ec-aac8-d2ff1c96acf6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:35.406552 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-2e008cca-ced1-48ec-aac8-d2ff1c96acf6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 200 len: 1265 microversion: 2.1 time: 0.155062 Jun 16 16:34:35.407126 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 662/1323] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:35 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:34:36.425922 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-e3559a32-ed1d-4fb4-a730-854714373c9a tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:36.426557 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-e3559a32-ed1d-4fb4-a730-854714373c9a tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:36.433073 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e3559a32-ed1d-4fb4-a730-854714373c9a tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:36.433547 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e3559a32-ed1d-4fb4-a730-854714373c9a tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:36.434525 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e3559a32-ed1d-4fb4-a730-854714373c9a tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:36.434995 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-e3559a32-ed1d-4fb4-a730-854714373c9a tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:36.585212 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-e3559a32-ed1d-4fb4-a730-854714373c9a tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:36.593466 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-e3559a32-ed1d-4fb4-a730-854714373c9a tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 200 len: 1265 microversion: 2.1 time: 0.173200 Jun 16 16:34:36.594088 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 662/1324] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:36 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:34:37.613590 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-37cc7595-aa6a-4f69-a333-ee9aed8e32e6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:37.614226 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-37cc7595-aa6a-4f69-a333-ee9aed8e32e6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:37.620754 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-37cc7595-aa6a-4f69-a333-ee9aed8e32e6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:37.621198 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-37cc7595-aa6a-4f69-a333-ee9aed8e32e6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:37.621986 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-37cc7595-aa6a-4f69-a333-ee9aed8e32e6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:37.622421 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-37cc7595-aa6a-4f69-a333-ee9aed8e32e6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:37.754708 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-37cc7595-aa6a-4f69-a333-ee9aed8e32e6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:37.762214 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-37cc7595-aa6a-4f69-a333-ee9aed8e32e6 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 200 len: 1452 microversion: 2.1 time: 0.154132 Jun 16 16:34:37.762782 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 663/1325] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:37 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:34:37.778126 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-68bbd3b3-ad87-4cc5-a973-fdd1f377728a tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:37.778748 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-68bbd3b3-ad87-4cc5-a973-fdd1f377728a tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:34:37.785878 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-68bbd3b3-ad87-4cc5-a973-fdd1f377728a tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:37.786329 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-68bbd3b3-ad87-4cc5-a973-fdd1f377728a tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:37.787093 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-68bbd3b3-ad87-4cc5-a973-fdd1f377728a tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:37.787529 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-68bbd3b3-ad87-4cc5-a973-fdd1f377728a tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:37.914829 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-68bbd3b3-ad87-4cc5-a973-fdd1f377728a tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:34:37.922672 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-68bbd3b3-ad87-4cc5-a973-fdd1f377728a tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 200 len: 1452 microversion: 2.1 time: 0.148617 Jun 16 16:34:37.923246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 663/1326] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:34:37 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:34:39.779471 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-42635ff2-5a95-4e0b-ac6d-4c3efd893e58 req-168711d9-26e9-434a-8d22-d82dd1ed5409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb562ba-8a15-4a83-87a8-cbc71a8ef147", "tag": "9c7b4fe8-06bc-40d3-afd2-f792aab2bc85"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:34:39.788695 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-42635ff2-5a95-4e0b-ac6d-4c3efd893e58 req-168711d9-26e9-434a-8d22-d82dd1ed5409 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:34:39.789322 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-42635ff2-5a95-4e0b-ac6d-4c3efd893e58 req-168711d9-26e9-434a-8d22-d82dd1ed5409 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:34:39.800882 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-42635ff2-5a95-4e0b-ac6d-4c3efd893e58 req-168711d9-26e9-434a-8d22-d82dd1ed5409 service nova] Creating event network-changed:9c7b4fe8-06bc-40d3-afd2-f792aab2bc85 for instance 6bb562ba-8a15-4a83-87a8-cbc71a8ef147 on hv-cinder-83735 Jun 16 16:34:39.806097 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-42635ff2-5a95-4e0b-ac6d-4c3efd893e58 req-168711d9-26e9-434a-8d22-d82dd1ed5409 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030196 Jun 16 16:34:39.806953 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 664/1327] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:35:58.996118 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:35:58.996884 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Thu Jun 16 16:35:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:36:06.078102 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:36:06.078774 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Thu Jun 16 16:36:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:36:51.524248 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:36:51.525018 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=68 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:36:51.529363 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-a180c2c4-c76d-47a1-a168-bc79b3678984 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1220772847", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-373824487", "security_groups": [{"name": "tempest-secgroup-smoke-1186202417"}], "block_device_mapping_v2": [{"uuid": "e61c4a53-6a2a-4d8e-881c-3204f21197dc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a4761258-d752-4e48-942f-d11f7b716bfd"}]}} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:36:51.642672 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.network.neutron [None req-a180c2c4-c76d-47a1-a168-bc79b3678984 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] validate_networks() for [('a4761258-d752-4e48-942f-d11f7b716bfd', None, None, None, None, None)] {{(pid=117712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:36:52.025314 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-a180c2c4-c76d-47a1-a168-bc79b3678984 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Flavor limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:36:52.025846 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-a180c2c4-c76d-47a1-a168-bc79b3678984 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Image limits 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:36:52.026328 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-a180c2c4-c76d-47a1-a168-bc79b3678984 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Flavor pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:36:52.026800 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-a180c2c4-c76d-47a1-a168-bc79b3678984 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Image pref 0:0:0 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:36:52.027242 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.virt.hardware [None req-a180c2c4-c76d-47a1-a168-bc79b3678984 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:36:52.036816 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a180c2c4-c76d-47a1-a168-bc79b3678984 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:36:52.037266 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a180c2c4-c76d-47a1-a168-bc79b3678984 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:36:52.039474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a180c2c4-c76d-47a1-a168-bc79b3678984 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:36:52.039474 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-a180c2c4-c76d-47a1-a168-bc79b3678984 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:36:52.056324 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-a180c2c4-c76d-47a1-a168-bc79b3678984 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Getting quotas for project 3643cc8acf58444383e525f1990d1129. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:36:52.060995 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.quota [None req-a180c2c4-c76d-47a1-a168-bc79b3678984 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Getting quotas for user 5bd17610e5f44d70a9f3f83abfc1e6c8 and project 3643cc8acf58444383e525f1990d1129. Resources: {'ram', 'instances', 'cores'} {{(pid=117712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:36:52.121508 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a180c2c4-c76d-47a1-a168-bc79b3678984 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Going to run 1 instances... {{(pid=117712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:36:52.123635 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-a180c2c4-c76d-47a1-a168-bc79b3678984 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e61c4a53-6a2a-4d8e-881c-3204f21197dc',volume_size=None,volume_type=None)] {{(pid=117712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:36:52.254787 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-a180c2c4-c76d-47a1-a168-bc79b3678984 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.732262 Jun 16 16:36:52.255421 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 664/1328] 10.222.0.88 () {60 vars in 1146 bytes} [Thu Jun 16 16:36:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:36:52.264525 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:36:52.265311 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:36:52.270727 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-0c9ed5b9-c1eb-4a4d-a130-0b13cfc8c587 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:36:52.271431 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-0c9ed5b9-c1eb-4a4d-a130-0b13cfc8c587 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:36:52.335169 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-0c9ed5b9-c1eb-4a4d-a130-0b13cfc8c587 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:36:52.342288 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-0c9ed5b9-c1eb-4a4d-a130-0b13cfc8c587 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 200 len: 1094 microversion: 2.1 time: 0.079906 Jun 16 16:36:52.344472 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 665/1329] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:36:52 2022] GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:36:53.360867 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c1682866-1c82-4b3d-85d4-cdf0e9353a18 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:36:53.361590 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c1682866-1c82-4b3d-85d4-cdf0e9353a18 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:36:53.369455 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c1682866-1c82-4b3d-85d4-cdf0e9353a18 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:36:53.370010 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c1682866-1c82-4b3d-85d4-cdf0e9353a18 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:36:53.370920 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c1682866-1c82-4b3d-85d4-cdf0e9353a18 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:36:53.371408 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c1682866-1c82-4b3d-85d4-cdf0e9353a18 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:36:53.672742 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c1682866-1c82-4b3d-85d4-cdf0e9353a18 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:36:53.680450 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c1682866-1c82-4b3d-85d4-cdf0e9353a18 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 200 len: 1210 microversion: 2.1 time: 0.323565 Jun 16 16:36:53.681130 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 665/1330] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:36:53 2022] GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 1210 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:36:54.697318 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-1b2ff7b5-75f3-4d14-b6ad-42bfeab54adf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:36:54.697959 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-1b2ff7b5-75f3-4d14-b6ad-42bfeab54adf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:36:54.706451 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1b2ff7b5-75f3-4d14-b6ad-42bfeab54adf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:36:54.706912 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1b2ff7b5-75f3-4d14-b6ad-42bfeab54adf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:36:54.707695 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1b2ff7b5-75f3-4d14-b6ad-42bfeab54adf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:36:54.708140 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-1b2ff7b5-75f3-4d14-b6ad-42bfeab54adf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:36:54.935318 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-1b2ff7b5-75f3-4d14-b6ad-42bfeab54adf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:36:54.944070 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-1b2ff7b5-75f3-4d14-b6ad-42bfeab54adf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 200 len: 1266 microversion: 2.1 time: 0.250519 Jun 16 16:36:54.945415 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 666/1331] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:36:54 2022] GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:36:55.274364 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-aca7b525-2556-4cff-a152-efe954a2075f req-82f606ee-a52e-4010-a462-f1e32f9cec7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25049969-9f0b-4bb6-928a-62947caa6e56", "tag": "55e20702-c624-4547-a1aa-ee0978d059e8"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:36:55.283135 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-aca7b525-2556-4cff-a152-efe954a2075f req-82f606ee-a52e-4010-a462-f1e32f9cec7a service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:36:55.284009 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-aca7b525-2556-4cff-a152-efe954a2075f req-82f606ee-a52e-4010-a462-f1e32f9cec7a service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:36:55.308505 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-aca7b525-2556-4cff-a152-efe954a2075f req-82f606ee-a52e-4010-a462-f1e32f9cec7a service nova] Creating event network-changed:55e20702-c624-4547-a1aa-ee0978d059e8 for instance 25049969-9f0b-4bb6-928a-62947caa6e56 on hv-cinder-83735 Jun 16 16:36:55.314877 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-aca7b525-2556-4cff-a152-efe954a2075f req-82f606ee-a52e-4010-a462-f1e32f9cec7a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162810 Jun 16 16:36:55.315773 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 666/1332] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:36:55.965413 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f16769d2-a1a9-42d6-8f1d-b7e2c28b4d82 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:36:55.966051 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f16769d2-a1a9-42d6-8f1d-b7e2c28b4d82 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:36:55.973006 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f16769d2-a1a9-42d6-8f1d-b7e2c28b4d82 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:36:55.973444 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f16769d2-a1a9-42d6-8f1d-b7e2c28b4d82 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:36:55.974230 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f16769d2-a1a9-42d6-8f1d-b7e2c28b4d82 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:36:55.974659 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f16769d2-a1a9-42d6-8f1d-b7e2c28b4d82 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:36:56.111091 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-f16769d2-a1a9-42d6-8f1d-b7e2c28b4d82 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:36:56.118625 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f16769d2-a1a9-42d6-8f1d-b7e2c28b4d82 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 200 len: 1266 microversion: 2.1 time: 0.157336 Jun 16 16:36:56.119188 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 667/1333] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:36:55 2022] GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:36:57.137246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-c5100088-d78a-4faa-9ef6-08d9508860ab tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:36:57.137246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-c5100088-d78a-4faa-9ef6-08d9508860ab tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:36:57.143885 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c5100088-d78a-4faa-9ef6-08d9508860ab tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:36:57.144337 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c5100088-d78a-4faa-9ef6-08d9508860ab tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:36:57.145111 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c5100088-d78a-4faa-9ef6-08d9508860ab tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:36:57.145549 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-c5100088-d78a-4faa-9ef6-08d9508860ab tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:36:57.286847 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-c5100088-d78a-4faa-9ef6-08d9508860ab tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:36:57.294384 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-c5100088-d78a-4faa-9ef6-08d9508860ab tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 200 len: 1266 microversion: 2.1 time: 0.162590 Jun 16 16:36:57.294950 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 667/1334] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:36:57 2022] GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:36:58.312650 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-199acb55-7de9-4f2e-8dc1-f4680cef3f96 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:36:58.313240 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-199acb55-7de9-4f2e-8dc1-f4680cef3f96 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:36:58.320220 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-199acb55-7de9-4f2e-8dc1-f4680cef3f96 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:36:58.320662 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-199acb55-7de9-4f2e-8dc1-f4680cef3f96 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:36:58.321419 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-199acb55-7de9-4f2e-8dc1-f4680cef3f96 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:36:58.321929 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-199acb55-7de9-4f2e-8dc1-f4680cef3f96 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:36:58.457411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-199acb55-7de9-4f2e-8dc1-f4680cef3f96 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:36:58.465215 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-199acb55-7de9-4f2e-8dc1-f4680cef3f96 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 200 len: 1266 microversion: 2.1 time: 0.156968 Jun 16 16:36:58.465812 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 668/1335] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:36:58 2022] GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:36:59.482435 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-9e1242cb-a539-4ff2-b67b-2c1c7b1d5ca0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:36:59.483074 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-9e1242cb-a539-4ff2-b67b-2c1c7b1d5ca0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:36:59.489539 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9e1242cb-a539-4ff2-b67b-2c1c7b1d5ca0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:36:59.490017 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9e1242cb-a539-4ff2-b67b-2c1c7b1d5ca0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:36:59.490782 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9e1242cb-a539-4ff2-b67b-2c1c7b1d5ca0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:36:59.491210 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-9e1242cb-a539-4ff2-b67b-2c1c7b1d5ca0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:36:59.626560 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-9e1242cb-a539-4ff2-b67b-2c1c7b1d5ca0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:36:59.634145 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-9e1242cb-a539-4ff2-b67b-2c1c7b1d5ca0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 200 len: 1266 microversion: 2.1 time: 0.155838 Jun 16 16:36:59.634726 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 668/1336] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:36:59 2022] GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:37:00.652076 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-a662e953-1187-45f2-91e6-f7b490033190 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:37:00.652690 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-a662e953-1187-45f2-91e6-f7b490033190 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:37:00.659958 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a662e953-1187-45f2-91e6-f7b490033190 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:37:00.660410 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a662e953-1187-45f2-91e6-f7b490033190 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:37:00.661198 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a662e953-1187-45f2-91e6-f7b490033190 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:37:00.661739 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-a662e953-1187-45f2-91e6-f7b490033190 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:37:00.803240 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-a662e953-1187-45f2-91e6-f7b490033190 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:37:00.810882 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-a662e953-1187-45f2-91e6-f7b490033190 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 200 len: 1266 microversion: 2.1 time: 0.162733 Jun 16 16:37:00.811451 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 669/1337] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:37:00 2022] GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:37:01.828596 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-1528d3a4-60ed-481a-bb31-ee2d1ee7229c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:37:01.829212 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-1528d3a4-60ed-481a-bb31-ee2d1ee7229c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:37:01.835956 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1528d3a4-60ed-481a-bb31-ee2d1ee7229c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:37:01.836413 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1528d3a4-60ed-481a-bb31-ee2d1ee7229c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:37:01.837190 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1528d3a4-60ed-481a-bb31-ee2d1ee7229c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:37:01.837632 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-1528d3a4-60ed-481a-bb31-ee2d1ee7229c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:37:01.969930 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-1528d3a4-60ed-481a-bb31-ee2d1ee7229c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:37:01.977459 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-1528d3a4-60ed-481a-bb31-ee2d1ee7229c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 200 len: 1266 microversion: 2.1 time: 0.153485 Jun 16 16:37:01.978325 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 669/1338] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:37:01 2022] GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:37:02.994948 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-4682b06a-e222-4512-9792-ba0d00d89be0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:37:02.995581 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-4682b06a-e222-4512-9792-ba0d00d89be0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:37:02.998001 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell0:SELECT=2 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:37:03.003628 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4682b06a-e222-4512-9792-ba0d00d89be0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:37:03.004071 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4682b06a-e222-4512-9792-ba0d00d89be0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:37:03.004835 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4682b06a-e222-4512-9792-ba0d00d89be0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:37:03.005262 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-4682b06a-e222-4512-9792-ba0d00d89be0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:37:03.145291 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-4682b06a-e222-4512-9792-ba0d00d89be0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:37:03.153079 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-4682b06a-e222-4512-9792-ba0d00d89be0 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 200 len: 1266 microversion: 2.1 time: 0.161969 Jun 16 16:37:03.153643 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 670/1339] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:37:02 2022] GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:37:04.171487 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-23f93a1a-9df4-40c0-ae4b-c55d18721ca7 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:37:04.172095 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-23f93a1a-9df4-40c0-ae4b-c55d18721ca7 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:37:04.174102 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=2 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:37:04.174761 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell0:SELECT=6 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:37:04.181136 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-23f93a1a-9df4-40c0-ae4b-c55d18721ca7 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:37:04.181586 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-23f93a1a-9df4-40c0-ae4b-c55d18721ca7 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:37:04.182397 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-23f93a1a-9df4-40c0-ae4b-c55d18721ca7 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:37:04.182838 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-23f93a1a-9df4-40c0-ae4b-c55d18721ca7 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:37:04.316822 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-23f93a1a-9df4-40c0-ae4b-c55d18721ca7 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:37:04.324676 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-23f93a1a-9df4-40c0-ae4b-c55d18721ca7 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 200 len: 1266 microversion: 2.1 time: 0.157572 Jun 16 16:37:04.325168 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 670/1340] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:37:04 2022] GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:37:05.260185 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-ff315b47-b6ae-419d-94b2-e0b0ada0ef79 req-6bcdf0dc-24ae-4fff-a359-63c8c1c4f8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25049969-9f0b-4bb6-928a-62947caa6e56", "name": "network-vif-plugged", "status": "completed", "tag": "55e20702-c624-4547-a1aa-ee0978d059e8"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:37:05.268851 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-ff315b47-b6ae-419d-94b2-e0b0ada0ef79 req-6bcdf0dc-24ae-4fff-a359-63c8c1c4f8d6 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:37:05.269300 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-ff315b47-b6ae-419d-94b2-e0b0ada0ef79 req-6bcdf0dc-24ae-4fff-a359-63c8c1c4f8d6 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:37:05.281087 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-ff315b47-b6ae-419d-94b2-e0b0ada0ef79 req-6bcdf0dc-24ae-4fff-a359-63c8c1c4f8d6 service nova] Creating event network-vif-plugged:55e20702-c624-4547-a1aa-ee0978d059e8 for instance 25049969-9f0b-4bb6-928a-62947caa6e56 on hv-cinder-83735 Jun 16 16:37:05.286268 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-ff315b47-b6ae-419d-94b2-e0b0ada0ef79 req-6bcdf0dc-24ae-4fff-a359-63c8c1c4f8d6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087000 Jun 16 16:37:05.286870 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 671/1341] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:37:05.341920 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-93eaf986-874d-4f16-bb7f-e828075208e1 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:37:05.342606 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-93eaf986-874d-4f16-bb7f-e828075208e1 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:37:05.349445 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-93eaf986-874d-4f16-bb7f-e828075208e1 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:37:05.349929 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-93eaf986-874d-4f16-bb7f-e828075208e1 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:37:05.350711 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-93eaf986-874d-4f16-bb7f-e828075208e1 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:37:05.351153 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-93eaf986-874d-4f16-bb7f-e828075208e1 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:37:05.501106 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-93eaf986-874d-4f16-bb7f-e828075208e1 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:37:05.514780 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-93eaf986-874d-4f16-bb7f-e828075208e1 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 200 len: 1266 microversion: 2.1 time: 0.171400 Jun 16 16:37:05.514780 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 671/1342] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:37:05 2022] GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:37:06.527227 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-ca6b1d03-d00e-45ab-9545-cecfec2808f2 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:37:06.527937 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-ca6b1d03-d00e-45ab-9545-cecfec2808f2 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:37:06.534185 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ca6b1d03-d00e-45ab-9545-cecfec2808f2 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:37:06.534626 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ca6b1d03-d00e-45ab-9545-cecfec2808f2 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:37:06.535406 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ca6b1d03-d00e-45ab-9545-cecfec2808f2 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:37:06.535831 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-ca6b1d03-d00e-45ab-9545-cecfec2808f2 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:37:06.673696 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-ca6b1d03-d00e-45ab-9545-cecfec2808f2 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:37:06.681415 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-ca6b1d03-d00e-45ab-9545-cecfec2808f2 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 200 len: 1266 microversion: 2.1 time: 0.158782 Jun 16 16:37:06.682032 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 672/1343] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:37:06 2022] GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:37:07.697998 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-d6aba130-7af0-4e66-9319-e7d1ebd4576e tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:37:07.698639 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-d6aba130-7af0-4e66-9319-e7d1ebd4576e tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:37:07.705899 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d6aba130-7af0-4e66-9319-e7d1ebd4576e tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:37:07.706359 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d6aba130-7af0-4e66-9319-e7d1ebd4576e tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:37:07.707128 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d6aba130-7af0-4e66-9319-e7d1ebd4576e tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:37:07.707561 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-d6aba130-7af0-4e66-9319-e7d1ebd4576e tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:37:07.844206 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-d6aba130-7af0-4e66-9319-e7d1ebd4576e tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:37:07.851699 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-d6aba130-7af0-4e66-9319-e7d1ebd4576e tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 200 len: 1453 microversion: 2.1 time: 0.157613 Jun 16 16:37:07.852262 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 672/1344] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:37:07 2022] GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:37:07.867733 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-46069712-7de2-49f3-bbe8-fb8e96b00d12 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:37:07.868329 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-46069712-7de2-49f3-bbe8-fb8e96b00d12 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:37:07.875462 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-46069712-7de2-49f3-bbe8-fb8e96b00d12 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:37:07.875906 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-46069712-7de2-49f3-bbe8-fb8e96b00d12 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:37:07.876666 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-46069712-7de2-49f3-bbe8-fb8e96b00d12 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:37:07.877100 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-46069712-7de2-49f3-bbe8-fb8e96b00d12 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:37:08.012105 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-46069712-7de2-49f3-bbe8-fb8e96b00d12 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:37:08.020627 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-46069712-7de2-49f3-bbe8-fb8e96b00d12 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 200 len: 1453 microversion: 2.1 time: 0.156637 Jun 16 16:37:08.021211 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 673/1345] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:37:07 2022] GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:37:09.960103 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-c1d5220e-2332-4d58-9df1-dc425c600223 req-04a65a19-547b-4fd0-866a-53f73b2e7410 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25049969-9f0b-4bb6-928a-62947caa6e56", "tag": "55e20702-c624-4547-a1aa-ee0978d059e8"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:37:09.969199 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-c1d5220e-2332-4d58-9df1-dc425c600223 req-04a65a19-547b-4fd0-866a-53f73b2e7410 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:37:09.970840 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-c1d5220e-2332-4d58-9df1-dc425c600223 req-04a65a19-547b-4fd0-866a-53f73b2e7410 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:37:09.984925 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-c1d5220e-2332-4d58-9df1-dc425c600223 req-04a65a19-547b-4fd0-866a-53f73b2e7410 service nova] Creating event network-changed:55e20702-c624-4547-a1aa-ee0978d059e8 for instance 25049969-9f0b-4bb6-928a-62947caa6e56 on hv-cinder-83735 Jun 16 16:37:09.990232 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-c1d5220e-2332-4d58-9df1-dc425c600223 req-04a65a19-547b-4fd0-866a-53f73b2e7410 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033718 Jun 16 16:37:09.991248 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 673/1346] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:37:45.437832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:37:45.438459 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Thu Jun 16 16:37:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:38:59.858554 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:38:59.859329 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG dbcounter [-] [117712] Writing DB stats nova_cell1:SELECT=48 {{(pid=117712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:38:59.861173 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_api:SELECT=20 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:38:59.862455 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG dbcounter [-] [117711] Writing DB stats nova_cell1:SELECT=44 {{(pid=117711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:38:59.866706 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-7111d11f-d32d-4c53-8318-49bd75c4f0fa tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:38:59.867207 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7111d11f-d32d-4c53-8318-49bd75c4f0fa tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:38:59.873948 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-934287b4-8615-4a0f-9589-ab5a201923f2 req-0b5ea442-6531-47f6-8014-04d7ad4001ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25049969-9f0b-4bb6-928a-62947caa6e56", "tag": "55e20702-c624-4547-a1aa-ee0978d059e8"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:38:59.883201 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7111d11f-d32d-4c53-8318-49bd75c4f0fa tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:38:59.883654 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7111d11f-d32d-4c53-8318-49bd75c4f0fa tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:38:59.884428 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7111d11f-d32d-4c53-8318-49bd75c4f0fa tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:38:59.884859 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-7111d11f-d32d-4c53-8318-49bd75c4f0fa tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:38:59.885106 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-934287b4-8615-4a0f-9589-ab5a201923f2 req-0b5ea442-6531-47f6-8014-04d7ad4001ce service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:38:59.885554 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-934287b4-8615-4a0f-9589-ab5a201923f2 req-0b5ea442-6531-47f6-8014-04d7ad4001ce service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:38:59.899183 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-934287b4-8615-4a0f-9589-ab5a201923f2 req-0b5ea442-6531-47f6-8014-04d7ad4001ce service nova] Creating event network-changed:55e20702-c624-4547-a1aa-ee0978d059e8 for instance 25049969-9f0b-4bb6-928a-62947caa6e56 on hv-cinder-83735 Jun 16 16:38:59.905417 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-934287b4-8615-4a0f-9589-ab5a201923f2 req-0b5ea442-6531-47f6-8014-04d7ad4001ce service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048952 Jun 16 16:38:59.906396 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 674/1347] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:38:59.913642 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-7111d11f-d32d-4c53-8318-49bd75c4f0fa tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Going to try to terminate instance {{(pid=117711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:39:00.008411 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-7111d11f-d32d-4c53-8318-49bd75c4f0fa tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "DELETE /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 204 len: 0 microversion: 2.1 time: 0.154140 Jun 16 16:39:00.009085 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 674/1348] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:38:59 2022] DELETE /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:39:00.019048 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-26543329-2ce6-442d-a42f-e01ec09e3281 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:39:00.020103 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-26543329-2ce6-442d-a42f-e01ec09e3281 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:39:00.026763 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-26543329-2ce6-442d-a42f-e01ec09e3281 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:00.027213 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-26543329-2ce6-442d-a42f-e01ec09e3281 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:00.027975 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-26543329-2ce6-442d-a42f-e01ec09e3281 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:00.028405 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-26543329-2ce6-442d-a42f-e01ec09e3281 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:00.172412 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-26543329-2ce6-442d-a42f-e01ec09e3281 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:39:00.179829 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-26543329-2ce6-442d-a42f-e01ec09e3281 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 200 len: 1577 microversion: 2.1 time: 0.166378 Jun 16 16:39:00.180388 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 675/1349] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:39:00 2022] GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:39:01.199157 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-99a0cd78-e91b-4e7d-a9eb-9e2ae62e7725 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:39:01.199768 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-99a0cd78-e91b-4e7d-a9eb-9e2ae62e7725 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:39:01.206953 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-99a0cd78-e91b-4e7d-a9eb-9e2ae62e7725 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:01.207398 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-99a0cd78-e91b-4e7d-a9eb-9e2ae62e7725 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:01.208146 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-99a0cd78-e91b-4e7d-a9eb-9e2ae62e7725 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:01.208573 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-99a0cd78-e91b-4e7d-a9eb-9e2ae62e7725 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:01.394044 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-99a0cd78-e91b-4e7d-a9eb-9e2ae62e7725 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:39:01.401649 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-99a0cd78-e91b-4e7d-a9eb-9e2ae62e7725 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 200 len: 1577 microversion: 2.1 time: 0.206803 Jun 16 16:39:01.402249 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 675/1350] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:39:01 2022] GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 1577 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:39:02.419064 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-8a726319-ac14-4b6b-b871-57a725623fbc tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:39:02.419683 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-8a726319-ac14-4b6b-b871-57a725623fbc tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:39:02.426798 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8a726319-ac14-4b6b-b871-57a725623fbc tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:02.427246 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8a726319-ac14-4b6b-b871-57a725623fbc tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:02.428009 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8a726319-ac14-4b6b-b871-57a725623fbc tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:02.428441 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-8a726319-ac14-4b6b-b871-57a725623fbc tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:02.661403 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-8a726319-ac14-4b6b-b871-57a725623fbc tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:39:02.668957 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-8a726319-ac14-4b6b-b871-57a725623fbc tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 200 len: 1577 microversion: 2.1 time: 0.253851 Jun 16 16:39:02.669522 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 676/1351] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:39:02 2022] GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 1577 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:39:02.912095 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-19797f88-a6f3-4d5c-9698-921a3f25e5cd req-52cb2b6a-b06a-488d-ab1e-dadd26d4c0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25049969-9f0b-4bb6-928a-62947caa6e56", "name": "network-vif-deleted", "tag": "55e20702-c624-4547-a1aa-ee0978d059e8"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:39:02.921489 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-19797f88-a6f3-4d5c-9698-921a3f25e5cd req-52cb2b6a-b06a-488d-ab1e-dadd26d4c0e4 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:02.922028 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-19797f88-a6f3-4d5c-9698-921a3f25e5cd req-52cb2b6a-b06a-488d-ab1e-dadd26d4c0e4 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:02.932894 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-19797f88-a6f3-4d5c-9698-921a3f25e5cd req-52cb2b6a-b06a-488d-ab1e-dadd26d4c0e4 service nova] Creating event network-vif-deleted:55e20702-c624-4547-a1aa-ee0978d059e8 for instance 25049969-9f0b-4bb6-928a-62947caa6e56 on hv-cinder-83735 Jun 16 16:39:02.938354 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-19797f88-a6f3-4d5c-9698-921a3f25e5cd req-52cb2b6a-b06a-488d-ab1e-dadd26d4c0e4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029926 Jun 16 16:39:02.939272 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 676/1352] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:39:03.687705 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-51ba970e-341c-4c22-9f09-9cc782471a39 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:39:03.688308 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-51ba970e-341c-4c22-9f09-9cc782471a39 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:39:03.695452 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-51ba970e-341c-4c22-9f09-9cc782471a39 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:03.695897 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-51ba970e-341c-4c22-9f09-9cc782471a39 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:03.696946 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-51ba970e-341c-4c22-9f09-9cc782471a39 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:03.697374 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-51ba970e-341c-4c22-9f09-9cc782471a39 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:03.728499 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-51ba970e-341c-4c22-9f09-9cc782471a39 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:03.729206 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-51ba970e-341c-4c22-9f09-9cc782471a39 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:03.729649 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.objects.instance [None req-51ba970e-341c-4c22-9f09-9cc782471a39 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lazy-loading 'fault' on Instance uuid 25049969-9f0b-4bb6-928a-62947caa6e56 {{(pid=117712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:39:03.770212 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-51ba970e-341c-4c22-9f09-9cc782471a39 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:39:03.777594 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-51ba970e-341c-4c22-9f09-9cc782471a39 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 200 len: 1230 microversion: 2.1 time: 0.094289 Jun 16 16:39:03.778185 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 677/1353] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:39:03 2022] GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:39:04.795504 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-39090abe-59d1-43f4-af24-79e4e9a08b35 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:39:04.796196 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-39090abe-59d1-43f4-af24-79e4e9a08b35 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 25049969-9f0b-4bb6-928a-62947caa6e56] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:39:04.802418 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-39090abe-59d1-43f4-af24-79e4e9a08b35 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:04.802872 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-39090abe-59d1-43f4-af24-79e4e9a08b35 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:04.803623 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-39090abe-59d1-43f4-af24-79e4e9a08b35 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:04.804057 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-39090abe-59d1-43f4-af24-79e4e9a08b35 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:04.817151 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-39090abe-59d1-43f4-af24-79e4e9a08b35 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] HTTP exception thrown: Instance 25049969-9f0b-4bb6-928a-62947caa6e56 could not be found. Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-39090abe-59d1-43f4-af24-79e4e9a08b35 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Request method failure captured: Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 HTTP/1.1 Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1q_aifSKNCXFcIBoY1svH5p5tFOMXXGrBhu5TnvYcse2ePDt2C48cKqPuZCPm7QvAo_CswYv7WmWWNAt1ROn72RYtn25HI4uyt6rBSkWYQ8FMwzzBsbzxm7M05_AZIKGacyLtNvVQgRDLHGK6terK2m_VHyrF3lgMumUHn2MIv85QQ Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: 3643cc8acf58444383e525f1990d1129 Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-TestVolumeBootPattern-419486644 Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:39:04.818777 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:39:04.820620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3643cc8acf58444383e525f1990d1129"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3643cc8acf58444383e525f1990d1129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3643cc8acf58444383e525f1990d1129", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3643cc8acf58444383e525f1990d1129"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:39:04.820620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-TestVolumeBootPattern-419486644 Jun 16 16:39:04.820620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 3643cc8acf58444383e525f1990d1129 Jun 16 16:39:04.820620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-TestVolumeBootPattern-419486644 Jun 16 16:39:04.820620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-TestVolumeBootPattern-419486644-project Jun 16 16:39:04.820620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:39:04.820620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:39:04.820620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: 5bd17610e5f44d70a9f3f83abfc1e6c8 Jun 16 16:39:04.820620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-TestVolumeBootPattern-419486644-project Jun 16 16:39:04.820620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:39:04.820620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance 25049969-9f0b-4bb6-928a-62947caa6e56 could not be found. Jun 16 16:39:04.820620 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '25049969-9f0b-4bb6-928a-62947caa6e56'} Jun 16 16:39:04.821790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:39:04.821790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:39:04.821790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:39:04.821790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:39:04.821790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:39:04.821790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:39:04.821790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:39:04.821790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:39:04.821790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:39:04.821790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:39:04.821790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25049969-9f0b-4bb6-928a-62947caa6e56 could not be found. Jun 16 16:39:04.821790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:39:04.821790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:39:04.821790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:39:04.821790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:39:04.821790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:39:04.821790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:39:04.821790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:39:04.821790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:39:04.821790 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:39:04.823832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:39:04.823832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:39:04.823832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:39:04.823832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:39:04.823832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:39:04.823832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:39:04.823832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:39:04.823832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25049969-9f0b-4bb6-928a-62947caa6e56 could not be found. Jun 16 16:39:04.823832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:39:04.823832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:39:04.823832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:39:04.823832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:39:04.823832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:39:04.823832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:39:04.823832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:39:04.823832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:39:04.823832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25049969-9f0b-4bb6-928a-62947caa6e56 could not be found. Jun 16 16:39:04.823832 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:39:04.825490 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-39090abe-59d1-43f4-af24-79e4e9a08b35 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Returning 404 to user: Instance 25049969-9f0b-4bb6-928a-62947caa6e56 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:39:04.825490 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-39090abe-59d1-43f4-af24-79e4e9a08b35 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56" status: 404 len: 111 microversion: 2.1 time: 0.029322 Jun 16 16:39:04.825490 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 677/1354] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:39:04 2022] GET /compute/v2.1/servers/25049969-9f0b-4bb6-928a-62947caa6e56 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:39:08.112416 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-bc2ef25b-233a-48b4-87a0-107fea2fbbac tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:39:08.113029 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-bc2ef25b-233a-48b4-87a0-107fea2fbbac tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:39:08.114843 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [req-e6cbc774-f580-4159-aea3-2fcaeacfff49 req-3eed5c89-d2bf-4564-a186-a9a47e863ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb562ba-8a15-4a83-87a8-cbc71a8ef147", "tag": "9c7b4fe8-06bc-40d3-afd2-f792aab2bc85"}]} {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:39:08.119424 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bc2ef25b-233a-48b4-87a0-107fea2fbbac tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:08.119864 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bc2ef25b-233a-48b4-87a0-107fea2fbbac tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:08.121023 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bc2ef25b-233a-48b4-87a0-107fea2fbbac tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:08.121023 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-bc2ef25b-233a-48b4-87a0-107fea2fbbac tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:08.124075 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-e6cbc774-f580-4159-aea3-2fcaeacfff49 req-3eed5c89-d2bf-4564-a186-a9a47e863ad3 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:08.124584 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [req-e6cbc774-f580-4159-aea3-2fcaeacfff49 req-3eed5c89-d2bf-4564-a186-a9a47e863ad3 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:08.136544 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.compute.server_external_events [req-e6cbc774-f580-4159-aea3-2fcaeacfff49 req-3eed5c89-d2bf-4564-a186-a9a47e863ad3 service nova] Creating event network-changed:9c7b4fe8-06bc-40d3-afd2-f792aab2bc85 for instance 6bb562ba-8a15-4a83-87a8-cbc71a8ef147 on hv-cinder-83735 Jun 16 16:39:08.145684 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [req-e6cbc774-f580-4159-aea3-2fcaeacfff49 req-3eed5c89-d2bf-4564-a186-a9a47e863ad3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034477 Jun 16 16:39:08.146627 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 678/1355] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:39:08.150284 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-bc2ef25b-233a-48b4-87a0-107fea2fbbac tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Going to try to terminate instance {{(pid=117712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:39:08.241962 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-bc2ef25b-233a-48b4-87a0-107fea2fbbac tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 204 len: 0 microversion: 2.1 time: 0.133093 Jun 16 16:39:08.249941 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 678/1356] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:39:08 2022] DELETE /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:39:08.252558 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-da181c40-5a42-4f2f-b21f-952080a33ecf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:39:08.253538 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-da181c40-5a42-4f2f-b21f-952080a33ecf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:39:08.260477 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-da181c40-5a42-4f2f-b21f-952080a33ecf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:08.260922 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-da181c40-5a42-4f2f-b21f-952080a33ecf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:08.261676 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-da181c40-5a42-4f2f-b21f-952080a33ecf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:08.262139 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-da181c40-5a42-4f2f-b21f-952080a33ecf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:08.397406 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-da181c40-5a42-4f2f-b21f-952080a33ecf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:39:08.405331 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-da181c40-5a42-4f2f-b21f-952080a33ecf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 200 len: 1577 microversion: 2.1 time: 0.157892 Jun 16 16:39:08.405920 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 679/1357] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:39:08 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:39:09.423060 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-01c692df-c8f5-42ee-88b2-810f7734e747 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:39:09.423703 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-01c692df-c8f5-42ee-88b2-810f7734e747 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:39:09.430169 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-01c692df-c8f5-42ee-88b2-810f7734e747 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:09.430623 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-01c692df-c8f5-42ee-88b2-810f7734e747 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:09.431390 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-01c692df-c8f5-42ee-88b2-810f7734e747 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:09.431830 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-01c692df-c8f5-42ee-88b2-810f7734e747 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:09.620200 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.policy [None req-01c692df-c8f5-42ee-88b2-810f7734e747 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117712) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:39:09.628297 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-01c692df-c8f5-42ee-88b2-810f7734e747 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 200 len: 1577 microversion: 2.1 time: 0.209540 Jun 16 16:39:09.628963 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 679/1358] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:39:09 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 1577 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:39:10.645882 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-69a81d8e-b21e-4ff1-b2f1-29aaf90df0d2 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:39:10.646579 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-69a81d8e-b21e-4ff1-b2f1-29aaf90df0d2 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:39:10.653549 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-69a81d8e-b21e-4ff1-b2f1-29aaf90df0d2 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:10.654053 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-69a81d8e-b21e-4ff1-b2f1-29aaf90df0d2 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:10.654827 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-69a81d8e-b21e-4ff1-b2f1-29aaf90df0d2 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:10.655366 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-69a81d8e-b21e-4ff1-b2f1-29aaf90df0d2 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:10.883754 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.policy [None req-69a81d8e-b21e-4ff1-b2f1-29aaf90df0d2 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd17610e5f44d70a9f3f83abfc1e6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3643cc8acf58444383e525f1990d1129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117711) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:39:10.891802 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-69a81d8e-b21e-4ff1-b2f1-29aaf90df0d2 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 200 len: 1458 microversion: 2.1 time: 0.249806 Jun 16 16:39:10.892363 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 680/1359] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:39:10 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 1458 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:39:10.912449 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [req-3626fbc7-7481-454a-bde4-ab487a464b6a req-4febadfa-2052-4981-8330-ede53d246291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb562ba-8a15-4a83-87a8-cbc71a8ef147", "name": "network-vif-deleted", "tag": "9c7b4fe8-06bc-40d3-afd2-f792aab2bc85"}]} {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:39:10.922839 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-3626fbc7-7481-454a-bde4-ab487a464b6a req-4febadfa-2052-4981-8330-ede53d246291 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:10.923504 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [req-3626fbc7-7481-454a-bde4-ab487a464b6a req-4febadfa-2052-4981-8330-ede53d246291 service nova] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:10.938492 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.compute.server_external_events [req-3626fbc7-7481-454a-bde4-ab487a464b6a req-4febadfa-2052-4981-8330-ede53d246291 service nova] Creating event network-vif-deleted:9c7b4fe8-06bc-40d3-afd2-f792aab2bc85 for instance 6bb562ba-8a15-4a83-87a8-cbc71a8ef147 on hv-cinder-83735 Jun 16 16:39:10.943939 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [req-3626fbc7-7481-454a-bde4-ab487a464b6a req-4febadfa-2052-4981-8330-ede53d246291 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035296 Jun 16 16:39:10.944766 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 680/1360] 10.222.0.88 () {64 vars in 1317 bytes} [Thu Jun 16 16:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:39:11.908957 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-22d0bb79-8288-4493-b948-533ce2ba561c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:39:11.909551 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-22d0bb79-8288-4493-b948-533ce2ba561c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: 6bb562ba-8a15-4a83-87a8-cbc71a8ef147] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:39:11.916362 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-22d0bb79-8288-4493-b948-533ce2ba561c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:11.916824 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-22d0bb79-8288-4493-b948-533ce2ba561c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:11.917569 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-22d0bb79-8288-4493-b948-533ce2ba561c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:11.918039 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-22d0bb79-8288-4493-b948-533ce2ba561c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:11.931971 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-22d0bb79-8288-4493-b948-533ce2ba561c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] HTTP exception thrown: Instance 6bb562ba-8a15-4a83-87a8-cbc71a8ef147 could not be found. Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-22d0bb79-8288-4493-b948-533ce2ba561c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Request method failure captured: Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 HTTP/1.1 Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1q_aifSKNCXFcIBoY1svH5p5tFOMXXGrBhu5TnvYcse2ePDt2C48cKqPuZCPm7QvAo_CswYv7WmWWNAt1ROn72RYtn25HI4uyt6rBSkWYQ8FMwzzBsbzxm7M05_AZIKGacyLtNvVQgRDLHGK6terK2m_VHyrF3lgMumUHn2MIv85QQ Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: 3643cc8acf58444383e525f1990d1129 Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-TestVolumeBootPattern-419486644 Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:39:11.933596 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:39:11.935487 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3643cc8acf58444383e525f1990d1129"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3643cc8acf58444383e525f1990d1129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3643cc8acf58444383e525f1990d1129", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3643cc8acf58444383e525f1990d1129"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:39:11.935487 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-TestVolumeBootPattern-419486644 Jun 16 16:39:11.935487 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 3643cc8acf58444383e525f1990d1129 Jun 16 16:39:11.935487 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-TestVolumeBootPattern-419486644 Jun 16 16:39:11.935487 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-TestVolumeBootPattern-419486644-project Jun 16 16:39:11.935487 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:39:11.935487 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:39:11.935487 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: 5bd17610e5f44d70a9f3f83abfc1e6c8 Jun 16 16:39:11.935487 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-TestVolumeBootPattern-419486644-project Jun 16 16:39:11.935487 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:39:11.935487 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance 6bb562ba-8a15-4a83-87a8-cbc71a8ef147 could not be found. Jun 16 16:39:11.935487 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': '6bb562ba-8a15-4a83-87a8-cbc71a8ef147'} Jun 16 16:39:11.936392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:39:11.936392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:39:11.936392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:39:11.936392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:39:11.936392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:39:11.936392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:39:11.936392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:39:11.936392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:39:11.936392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:39:11.936392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:39:11.936392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bb562ba-8a15-4a83-87a8-cbc71a8ef147 could not be found. Jun 16 16:39:11.936392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:39:11.936392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:39:11.936392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:39:11.936392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:39:11.936392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:39:11.936392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:39:11.936392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:39:11.936392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:39:11.936392 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:39:11.937938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:39:11.937938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:39:11.937938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:39:11.937938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:39:11.937938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:39:11.937938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:39:11.937938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:39:11.937938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bb562ba-8a15-4a83-87a8-cbc71a8ef147 could not be found. Jun 16 16:39:11.937938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:39:11.937938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:39:11.937938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:39:11.937938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:39:11.937938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:39:11.937938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:39:11.937938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:39:11.937938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:39:11.937938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bb562ba-8a15-4a83-87a8-cbc71a8ef147 could not be found. Jun 16 16:39:11.937938 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:39:11.939303 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-22d0bb79-8288-4493-b948-533ce2ba561c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Returning 404 to user: Instance 6bb562ba-8a15-4a83-87a8-cbc71a8ef147 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:39:11.939303 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-22d0bb79-8288-4493-b948-533ce2ba561c tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147" status: 404 len: 111 microversion: 2.1 time: 0.030414 Jun 16 16:39:11.939303 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 681/1361] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:39:11 2022] GET /compute/v2.1/servers/6bb562ba-8a15-4a83-87a8-cbc71a8ef147 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:39:12.372825 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7b3ba35f-9699-4e9f-9226-0cdf46c345c1 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:39:12.373822 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.compute.api [None req-7b3ba35f-9699-4e9f-9226-0cdf46c345c1 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117712) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:39:12.379993 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7b3ba35f-9699-4e9f-9226-0cdf46c345c1 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:12.380439 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7b3ba35f-9699-4e9f-9226-0cdf46c345c1 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:12.381191 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7b3ba35f-9699-4e9f-9226-0cdf46c345c1 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:12.381621 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG oslo_concurrency.lockutils [None req-7b3ba35f-9699-4e9f-9226-0cdf46c345c1 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:12.395151 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.wsgi [None req-7b3ba35f-9699-4e9f-9226-0cdf46c345c1 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] HTTP exception thrown: Instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 could not be found. Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7b3ba35f-9699-4e9f-9226-0cdf46c345c1 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Request method failure captured: Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: request: DELETE /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 HTTP/1.1 Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept: application/json Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Accept-Encoding: identity Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Connection: close Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Length: 0 Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Content-Type: application/json Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Host: 10.222.0.88 Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Openstack-System-Scope: None Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: User-Agent: python-urllib3/1.26.9 Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Auth-Token: gAAAAABiq1q_aifSKNCXFcIBoY1svH5p5tFOMXXGrBhu5TnvYcse2ePDt2C48cKqPuZCPm7QvAo_CswYv7WmWWNAt1ROn72RYtn25HI4uyt6rBSkWYQ8FMwzzBsbzxm7M05_AZIKGacyLtNvVQgRDLHGK6terK2m_VHyrF3lgMumUHn2MIv85QQ Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Id: None Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Domain-Name: None Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Identity-Status: Confirmed Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Is-Admin-Project: True Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Id: default Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Domain-Name: Default Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Id: 3643cc8acf58444383e525f1990d1129 Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Project-Name: tempest-TestVolumeBootPattern-419486644 Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Role: reader,member Jun 16 16:39:12.396758 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Roles: reader,member Jun 16 16:39:12.398555 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3643cc8acf58444383e525f1990d1129"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3643cc8acf58444383e525f1990d1129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3643cc8acf58444383e525f1990d1129", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3643cc8acf58444383e525f1990d1129"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:39:12.398555 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant: tempest-TestVolumeBootPattern-419486644 Jun 16 16:39:12.398555 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Id: 3643cc8acf58444383e525f1990d1129 Jun 16 16:39:12.398555 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-Tenant-Name: tempest-TestVolumeBootPattern-419486644 Jun 16 16:39:12.398555 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User: tempest-TestVolumeBootPattern-419486644-project Jun 16 16:39:12.398555 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Id: default Jun 16 16:39:12.398555 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Domain-Name: Default Jun 16 16:39:12.398555 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Id: 5bd17610e5f44d70a9f3f83abfc1e6c8 Jun 16 16:39:12.398555 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: X-User-Name: tempest-TestVolumeBootPattern-419486644-project Jun 16 16:39:12.398555 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: method: > Jun 16 16:39:12.398555 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: exception: Instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 could not be found. Jun 16 16:39:12.398555 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: action_args: {'id': 'abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6'} Jun 16 16:39:12.399604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:39:12.399604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:39:12.399604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:39:12.399604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:39:12.399604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:39:12.399604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:39:12.399604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:39:12.399604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:39:12.399604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:39:12.399604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:39:12.399604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 could not be found. Jun 16 16:39:12.399604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:39:12.399604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:39:12.399604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:39:12.399604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:39:12.399604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:39:12.399604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:39:12.399604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:39:12.399604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:39:12.399604 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:39:12.401415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:39:12.401415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:39:12.401415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:39:12.401415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:39:12.401415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:39:12.401415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:39:12.401415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:39:12.401415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:39:12.401415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:39:12.401415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 could not be found. Jun 16 16:39:12.401415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:39:12.401415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:39:12.401415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:39:12.401415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:39:12.401415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:39:12.401415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:39:12.401415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:39:12.401415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:39:12.401415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 could not be found. Jun 16 16:39:12.401415 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR nova.api.openstack.wsgi Jun 16 16:39:12.403156 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-7b3ba35f-9699-4e9f-9226-0cdf46c345c1 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Returning 404 to user: Instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 could not be found. {{(pid=117712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:39:12.403156 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-7b3ba35f-9699-4e9f-9226-0cdf46c345c1 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "DELETE /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 404 len: 111 microversion: 2.1 time: 0.029970 Jun 16 16:39:12.403156 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 681/1362] 10.222.0.88 () {58 vars in 1238 bytes} [Thu Jun 16 16:39:12 2022] DELETE /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:39:12.407235 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f890da64-94bc-4341-98b0-2a4db5199ccf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '>' {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:39:12.407840 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.compute.api [None req-f890da64-94bc-4341-98b0-2a4db5199ccf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [instance: abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6] Fetching instance by UUID {{(pid=117711) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:39:12.414823 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f890da64-94bc-4341-98b0-2a4db5199ccf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:12.415271 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f890da64-94bc-4341-98b0-2a4db5199ccf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:12.416022 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f890da64-94bc-4341-98b0-2a4db5199ccf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:12.416455 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG oslo_concurrency.lockutils [None req-f890da64-94bc-4341-98b0-2a4db5199ccf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Lock "bf72e9e5-e7ed-4e44-b62a-c0132a022092" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:12.436323 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.wsgi [None req-f890da64-94bc-4341-98b0-2a4db5199ccf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] HTTP exception thrown: Instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 could not be found. Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f890da64-94bc-4341-98b0-2a4db5199ccf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Request method failure captured: Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: request: GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 HTTP/1.1 Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept: application/json Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Accept-Encoding: identity Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Connection: close Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Length: 0 Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Content-Type: application/json Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Host: 10.222.0.88 Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Openstack-System-Scope: None Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: User-Agent: python-urllib3/1.26.9 Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Auth-Token: gAAAAABiq1q_aifSKNCXFcIBoY1svH5p5tFOMXXGrBhu5TnvYcse2ePDt2C48cKqPuZCPm7QvAo_CswYv7WmWWNAt1ROn72RYtn25HI4uyt6rBSkWYQ8FMwzzBsbzxm7M05_AZIKGacyLtNvVQgRDLHGK6terK2m_VHyrF3lgMumUHn2MIv85QQ Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Id: None Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Domain-Name: None Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Identity-Status: Confirmed Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Is-Admin-Project: True Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Id: default Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Domain-Name: Default Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Id: 3643cc8acf58444383e525f1990d1129 Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Project-Name: tempest-TestVolumeBootPattern-419486644 Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Role: reader,member Jun 16 16:39:12.439915 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Roles: reader,member Jun 16 16:39:12.441769 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3643cc8acf58444383e525f1990d1129"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3643cc8acf58444383e525f1990d1129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3643cc8acf58444383e525f1990d1129", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3643cc8acf58444383e525f1990d1129"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}] Jun 16 16:39:12.441769 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant: tempest-TestVolumeBootPattern-419486644 Jun 16 16:39:12.441769 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Id: 3643cc8acf58444383e525f1990d1129 Jun 16 16:39:12.441769 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-Tenant-Name: tempest-TestVolumeBootPattern-419486644 Jun 16 16:39:12.441769 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User: tempest-TestVolumeBootPattern-419486644-project Jun 16 16:39:12.441769 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Id: default Jun 16 16:39:12.441769 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Domain-Name: Default Jun 16 16:39:12.441769 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Id: 5bd17610e5f44d70a9f3f83abfc1e6c8 Jun 16 16:39:12.441769 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: X-User-Name: tempest-TestVolumeBootPattern-419486644-project Jun 16 16:39:12.441769 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: method: > Jun 16 16:39:12.441769 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: exception: Instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 could not be found. Jun 16 16:39:12.441769 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: action_args: {'id': 'abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6'} Jun 16 16:39:12.442868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: {{(pid=117711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:39:12.442868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:39:12.442868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:39:12.442868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:39:12.442868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:39:12.442868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:39:12.442868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:39:12.442868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:39:12.442868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:39:12.442868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:39:12.442868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 could not be found. Jun 16 16:39:12.442868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:39:12.442868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:39:12.442868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:39:12.442868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:39:12.442868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:39:12.442868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:39:12.442868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:39:12.442868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:39:12.442868 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:39:12.444855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:39:12.444855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:39:12.444855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:39:12.444855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:39:12.444855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:39:12.444855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:39:12.444855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:39:12.444855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 could not be found. Jun 16 16:39:12.444855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:39:12.444855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:39:12.444855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:39:12.444855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:39:12.444855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:39:12.444855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:39:12.444855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:39:12.444855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:39:12.444855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 could not be found. Jun 16 16:39:12.444855 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: ERROR nova.api.openstack.wsgi Jun 16 16:39:12.446925 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: DEBUG nova.api.openstack.wsgi [None req-f890da64-94bc-4341-98b0-2a4db5199ccf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Returning 404 to user: Instance abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 could not be found. {{(pid=117711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:39:12.446925 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO nova.api.openstack.requestlog [None req-f890da64-94bc-4341-98b0-2a4db5199ccf tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6" status: 404 len: 111 microversion: 2.1 time: 0.039191 Jun 16 16:39:12.446925 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: [pid: 117711|app: 0|req: 682/1363] 10.222.0.88 () {58 vars in 1235 bytes} [Thu Jun 16 16:39:12 2022] GET /compute/v2.1/servers/abe0f5c7-dc96-4d52-a5c4-ef59a8c534b6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:39:13.737078 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: DEBUG nova.api.openstack.wsgi [None req-b0854ff6-69e5-4231-b0c8-182a32fa7297 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] Calling method '.version_select at 0x7f6f0ce08160>' {{(pid=117712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:39:13.741133 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b0854ff6-69e5-4231-b0c8-182a32fa7297 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [324d98b2-795b-4a45-b0d9-9845d1b2aeb8] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 16:39:14.749994 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO oslo.messaging._drivers.impl_rabbit [None req-b0854ff6-69e5-4231-b0c8-182a32fa7297 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] [324d98b2-795b-4a45-b0d9-9845d1b2aeb8] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 37856. Jun 16 16:39:14.767605 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO nova.api.openstack.requestlog [None req-b0854ff6-69e5-4231-b0c8-182a32fa7297 tempest-TestVolumeBootPattern-419486644 tempest-TestVolumeBootPattern-419486644-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-373824487" status: 202 len: 0 microversion: 2.1 time: 1.035067 Jun 16 16:39:14.768210 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: [pid: 117712|app: 0|req: 682/1364] 10.222.0.88 () {58 vars in 1259 bytes} [Thu Jun 16 16:39:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-373824487 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:39:19.005030 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:39:19.005600 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Thu Jun 16 16:39:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:41:05.446084 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:41:05.446672 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Thu Jun 16 16:41:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:41:22.675843 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:41:22.676723 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Thu Jun 16 16:41:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:42:39.016692 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:42:39.017432 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Thu Jun 16 16:42:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:42:44.097607 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:42:44.098262 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Thu Jun 16 16:42:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:44:25.455374 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:44:25.455994 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Thu Jun 16 16:44:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:44:26.092249 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:44:26.092836 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Thu Jun 16 16:44:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:44:39.485143 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:44:39.485814 dv-cinder-837354-2-iscsi devstack@n-api.service[117712]: Thu Jun 16 16:44:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:44:42.684157 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:44:42.684796 dv-cinder-837354-2-iscsi devstack@n-api.service[117711]: Thu Jun 16 16:44:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!